Apr 21 13:51:33 user devstack@n-api.service[61725]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 21 13:51:33 user devstack@n-api.service[61725]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 21 13:51:33 2023] *** Apr 21 13:51:33 user devstack@n-api.service[61725]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 21 13:51:33 user devstack@n-api.service[61725]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 21 13:51:33 user devstack@n-api.service[61725]: nodename: user Apr 21 13:51:33 user devstack@n-api.service[61725]: machine: x86_64 Apr 21 13:51:33 user devstack@n-api.service[61725]: clock source: unix Apr 21 13:51:33 user devstack@n-api.service[61725]: pcre jit disabled Apr 21 13:51:33 user devstack@n-api.service[61725]: detected number of CPU cores: 12 Apr 21 13:51:33 user devstack@n-api.service[61725]: current working directory: / Apr 21 13:51:33 user devstack@n-api.service[61725]: detected binary path: /usr/bin/uwsgi-core Apr 21 13:51:33 user devstack@n-api.service[61725]: your processes number limit is 63638 Apr 21 13:51:33 user devstack@n-api.service[61725]: your memory page size is 4096 bytes Apr 21 13:51:33 user devstack@n-api.service[61725]: detected max file descriptor number: 2048 Apr 21 13:51:33 user devstack@n-api.service[61725]: lock engine: pthread robust mutexes Apr 21 13:51:33 user devstack@n-api.service[61725]: thunder lock: enabled Apr 21 13:51:33 user devstack@n-api.service[61725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 21 13:51:33 user devstack@n-api.service[61725]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 21 13:51:33 user devstack@n-api.service[61725]: Python main interpreter initialized at 0x55f1683b8990 Apr 21 13:51:33 user devstack@n-api.service[61725]: python threads support enabled Apr 21 13:51:33 user devstack@n-api.service[61725]: your server socket listen backlog is limited to 100 connections Apr 21 13:51:33 user devstack@n-api.service[61725]: your mercy for graceful operations on workers is 90 seconds Apr 21 13:51:33 user devstack@n-api.service[61725]: mapped 537436 bytes (524 KB) for 3 cores Apr 21 13:51:33 user devstack@n-api.service[61725]: *** Operational MODE: preforking *** Apr 21 13:51:33 user devstack@n-api.service[61725]: *** uWSGI is running in multiple interpreter mode *** Apr 21 13:51:33 user devstack@n-api.service[61725]: spawned uWSGI master process (pid: 61725) Apr 21 13:51:33 user devstack@n-api.service[61725]: spawned uWSGI worker 1 (pid: 61726, cores: 1) Apr 21 13:51:33 user devstack@n-api.service[61725]: spawned uWSGI worker 2 (pid: 61727, cores: 1) Apr 21 13:51:33 user devstack@n-api.service[61725]: spawned uWSGI worker 3 (pid: 61728, cores: 1) Apr 21 13:51:33 user devstack@n-api.service[61725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 21 13:51:34 user devstack@n-api.service[61727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 13:51:34 user devstack@n-api.service[61726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 13:51:34 user devstack@n-api.service[61728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 13:51:37 user devstack@n-api.service[61728]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 13:51:37 user devstack@n-api.service[61728]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 13:51:37 user devstack@n-api.service[61728]: and ``live_migration_inbound_addr`` respectively. Apr 21 13:51:37 user devstack@n-api.service[61728]: ). Its value may be silently ignored in the future. Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 13:51:37 user devstack@n-api.service[61726]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 13:51:37 user devstack@n-api.service[61726]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 13:51:37 user devstack@n-api.service[61726]: and ``live_migration_inbound_addr`` respectively. Apr 21 13:51:37 user devstack@n-api.service[61726]: ). Its value may be silently ignored in the future. Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 13:51:37 user devstack@n-api.service[61727]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 13:51:37 user devstack@n-api.service[61727]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 13:51:37 user devstack@n-api.service[61727]: and ``live_migration_inbound_addr`` respectively. Apr 21 13:51:37 user devstack@n-api.service[61727]: ). Its value may be silently ignored in the future. Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61726) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 13:51:37 user devstack@n-api.service[61728]: INFO dbcounter [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Registered counter for database nova_api Apr 21 13:51:37 user devstack@n-api.service[61726]: INFO dbcounter [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Registered counter for database nova_api Apr 21 13:51:37 user devstack@n-api.service[61727]: INFO dbcounter [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Registered counter for database nova_api Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_db.sqlalchemy.engines [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61726) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writer thread running {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG nova.context [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9766f0b7-af82-4ef0-80ec-eb47f9a7deea(cell1) {{(pid=61727) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG nova.context [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9766f0b7-af82-4ef0-80ec-eb47f9a7deea(cell1) {{(pid=61728) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG nova.context [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9766f0b7-af82-4ef0-80ec-eb47f9a7deea(cell1) {{(pid=61726) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 13:51:37 user devstack@n-api.service[61727]: INFO dbcounter [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Registered counter for database nova_cell0 Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61727]: INFO dbcounter [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Registered counter for database nova_cell1 Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:51:37 user devstack@n-api.service[61726]: INFO dbcounter [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Registered counter for database nova_cell0 Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:51:37 user devstack@n-api.service[61726]: INFO dbcounter [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Registered counter for database nova_cell1 Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61728]: INFO dbcounter [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Registered counter for database nova_cell0 Apr 21 13:51:37 user devstack@n-api.service[61728]: INFO dbcounter [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Registered counter for database nova_cell1 Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_db.sqlalchemy.engines [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61726) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writer thread running {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG oslo_db.sqlalchemy.engines [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61726) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61727]: INFO dbcounter [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Registered counter for database nova_cell0 Apr 21 13:51:37 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writer thread running {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:37 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:37 user devstack@n-api.service[61726]: INFO dbcounter [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Registered counter for database nova_cell0 Apr 21 13:51:37 user devstack@n-api.service[61728]: INFO dbcounter [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Registered counter for database nova_cell0 Apr 21 13:51:38 user devstack@n-api.service[61726]: DEBUG oslo_db.sqlalchemy.engines [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61726) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:38 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writer thread running {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:38 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 13:51:38 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 13:51:38 user devstack@n-api.service[61726]: WARNING keystonemiddleware.auth_token [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61726]: WARNING keystonemiddleware.auth_token [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61726]: WARNING keystonemiddleware.auth_token [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61726]: WARNING keystonemiddleware.auth_token [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61726]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f1683b8990 pid: 61726 (default app) Apr 21 13:51:38 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:51:38 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001679 Apr 21 13:51:38 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 21 13:51:38 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:51:38 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 13:51:38 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-38e055b4-65bb-4a0c-afbc-9e97df5b0ca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 13:51:38 user devstack@n-api.service[61728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f1683b8990 pid: 61728 (default app) Apr 21 13:51:38 user devstack@n-api.service[61727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f1683b8990 pid: 61727 (default app) Apr 21 13:53:49 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5725617c-c998-46da-8f25-b3cb45ea3d70 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001593 Apr 21 13:53:49 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:53:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:53:49 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:49 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:49 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:49 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6ee990d0-9e82-4920-9b6e-84feb3631c3d admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6ee990d0-9e82-4920-9b6e-84feb3631c3d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.393185 Apr 21 13:53:50 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 13:53:49 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:53:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004154 Apr 21 13:53:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:53:51 2023] GET /compute/v2.1 => generated 387 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:53:51 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:51 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:51 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:51 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:53:52 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-55d7230a-d288-474c-bcbf-a4c7a09cabf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-55d7230a-d288-474c-bcbf-a4c7a09cabf0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.330337 Apr 21 13:53:52 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:53:51 2023] POST /compute/v2.1/flavors => generated 405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:53:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-efbc7d00-aa01-4f39-bd13-d4736423279e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:52 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-efbc7d00-aa01-4f39-bd13-d4736423279e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045856 Apr 21 13:53:52 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 13:53:52 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:53:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 21 13:53:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:53:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:53:54 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-ac2311be-3e26-4c91-9f43-8384a75aa77f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:54 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-ac2311be-3e26-4c91-9f43-8384a75aa77f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082630 Apr 21 13:53:54 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:53:54 2023] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:53:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6f0ad9e9-043d-42bc-8dc5-a6213b6900a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6f0ad9e9-043d-42bc-8dc5-a6213b6900a6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030332 Apr 21 13:53:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 13:53:54 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:53:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001479 Apr 21 13:53:56 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:53:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:53:56 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-1379be87-9461-402f-8674-9133c9f2a3ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:56 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-1379be87-9461-402f-8674-9133c9f2a3ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060326 Apr 21 13:53:56 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:53:56 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:53:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f61df0a6-b4dc-49ba-b4c6-513402695dc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f61df0a6-b4dc-49ba-b4c6-513402695dc0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033694 Apr 21 13:53:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 13:53:56 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 13:53:58 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:53:58 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001391 Apr 21 13:53:58 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:53:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:53:58 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8eef9d8f-8716-4373-9679-3e15959a06a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "d3", "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:58 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-8eef9d8f-8716-4373-9679-3e15959a06a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069703 Apr 21 13:53:58 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:53:58 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:53:58 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ebfd7366-6b16-4860-906e-e4fbb1154358 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:53:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ebfd7366-6b16-4860-906e-e4fbb1154358 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024458 Apr 21 13:53:58 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 13:53:58 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 21 13:54:00 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:00 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-88788daf-1a01-4cdb-9e66-de1a1498a4c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:00 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-88788daf-1a01-4cdb-9e66-de1a1498a4c0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059040 Apr 21 13:54:00 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:00 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024913 Apr 21 13:54:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 13:54:00 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c9554d33-5d75-4c7b-913e-9c28706a8ff6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002098 Apr 21 13:54:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:02 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:02 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-c7505577-e171-4066-ab82-139fc774adac admin admin] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:02 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-c7505577-e171-4066-ab82-139fc774adac admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.084122 Apr 21 13:54:02 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 13:54:02 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 13:54:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:04 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001552 Apr 21 13:54:04 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:54:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:54:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:54:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:54:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-0fd87ac4-5a2b-49f6-ba3d-a855f6568cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-0fd87ac4-5a2b-49f6-ba3d-a855f6568cb0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.343714 Apr 21 13:54:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:04 2023] POST /compute/v2.1/flavors => generated 400 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:04 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-1d82c358-0215-4792-820a-35f4036aa0ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:04 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-1d82c358-0215-4792-820a-35f4036aa0ce admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038260 Apr 21 13:54:04 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 13:54:04 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:06 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:06 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001350 Apr 21 13:54:06 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:06 2023] GET /compute/v2.1 => generated 387 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:06 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3e494a51-be62-4aac-a12c-e823a58d02e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:06 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-3e494a51-be62-4aac-a12c-e823a58d02e8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061047 Apr 21 13:54:06 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:06 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:06 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b471c8be-6c43-43a8-a2f2-fd94a6ddc6e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:06 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b471c8be-6c43-43a8-a2f2-fd94a6ddc6e9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030504 Apr 21 13:54:06 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 13:54:06 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001354 Apr 21 13:54:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:08 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-accfd865-58b2-4bb8-99db-e5fae62bd264 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "vcpus": 2, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-accfd865-58b2-4bb8-99db-e5fae62bd264 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.056550 Apr 21 13:54:08 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:08 2023] POST /compute/v2.1/flavors => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:08 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-fc09665a-c7ed-4fc8-8305-dd93423c0b2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:08 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-fc09665a-c7ed-4fc8-8305-dd93423c0b2d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024474 Apr 21 13:54:08 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 13:54:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001346 Apr 21 13:54:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-315f77e8-944c-4638-b896-ec041c224942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "swap": 0}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-315f77e8-944c-4638-b896-ec041c224942 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057740 Apr 21 13:54:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:10 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-671bbe40-efda-4f68-9acf-0e96b963eda0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:10 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-671bbe40-efda-4f68-9acf-0e96b963eda0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.022697 Apr 21 13:54:10 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 13:54:10 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001360 Apr 21 13:54:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 13:54:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:12 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-316e9d28-f28c-44d9-8ae3-96513f6b3072 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:12 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-316e9d28-f28c-44d9-8ae3-96513f6b3072 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.224268 Apr 21 13:54:12 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 13:54:12 2023] POST /compute/v2.1/flavors => generated 406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:54:12 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f3825c07-f4e6-43c5-b1bb-dff2b87eb2a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:54:13 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f3825c07-f4e6-43c5-b1bb-dff2b87eb2a6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029211 Apr 21 13:54:13 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 13:54:12 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:54:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bdc954e0-5857-4c24-b524-2bbf86a50841 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001478 Apr 21 13:54:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 13:54:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:54:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:54:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.335052 Apr 21 13:54:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 21 13:54:45 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:55:17 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f3825c07-f4e6-43c5-b1bb-dff2b87eb2a6 admin admin] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:55:17 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f3825c07-f4e6-43c5-b1bb-dff2b87eb2a6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002144 Apr 21 13:55:17 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 13:55:17 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:55:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:55:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e392165f-1ab2-4864-a3c0-465f68dfd24b admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:55:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e392165f-1ab2-4864-a3c0-465f68dfd24b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.072845 Apr 21 13:55:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 21 13:55:17 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 13:55:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:55:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001718 Apr 21 13:55:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 13:55:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:55:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:55:22 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-fac54df1-fe0f-4bb8-b2e5-fd4e7da321e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "swap": 0, "disk": 1, "id": "42", "vcpus": 1, "ram": 128, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:55:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-fac54df1-fe0f-4bb8-b2e5-fd4e7da321e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068851 Apr 21 13:55:22 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 13:55:22 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:55:22 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d91889eb-7067-43d5-959c-ece590f8df4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:55:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d91889eb-7067-43d5-959c-ece590f8df4c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027920 Apr 21 13:55:22 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 13:55:22 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:55:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:55:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f89f7161-f2d0-4672-97f9-e2a0940a3159 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001364 Apr 21 13:55:26 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 13:55:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:55:26 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-9684c22c-30b6-4867-ab6a-a7a744875b87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 192, "id": "84", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:55:26 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-9684c22c-30b6-4867-ab6a-a7a744875b87 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061064 Apr 21 13:55:26 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 13:55:26 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 13:55:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-17c82c94-16dd-4206-95ea-65de75f882fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:55:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-17c82c94-16dd-4206-95ea-65de75f882fc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024781 Apr 21 13:55:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 13:55:26 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:57:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:57:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:57:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:57:52 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-97aa2b9b-1482-4783-a7c2-245a1cce8740 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Action: 'create', calling method: .version_select at 0x7f160eda2cb0>, body: {"keypair": {"name": "tempest-keypair-1234083121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmS+b9xlwFpk/ZB8qhPKYszGUSbkqS/wmxdPA2+EZTBrrlLdczt4kqaoNpF+PGGMbYhMksCR0Bk+16nj7FF3bWR1LjQ0yuktGjeeohbe83sc0eREByhabKclSuVNg5vfQ=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:57:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-97aa2b9b-1482-4783-a7c2-245a1cce8740 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for project 91f5972380fd48eabffd46e6727239ce. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:57:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-97aa2b9b-1482-4783-a7c2-245a1cce8740 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for user 113884844de14ec7ac8a20ba06a389b3 and project 91f5972380fd48eabffd46e6727239ce. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:57:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-97aa2b9b-1482-4783-a7c2-245a1cce8740 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234233 Apr 21 13:57:52 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:57:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:57:59 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:57:59 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-872679092", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "23a0f330-371d-4fe5-befe-bc4147bf09c7"}], "security_groups": [{"name": "tempest-securitygroup--320871807"}], "key_name": "tempest-keypair-1234083121", "user_data": "}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:57:59 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] validate_networks() for [('23a0f330-371d-4fe5-befe-bc4147bf09c7', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for project 91f5972380fd48eabffd46e6727239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for user 113884844de14ec7ac8a20ba06a389b3 and project 91f5972380fd48eabffd46e6727239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:02 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:02 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-ccc096dc-6294-43c3-8d29-79d5ea855c6a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 3.280558 Apr 21 13:58:02 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:57:59 2023] POST /compute/v2.1/servers => generated 399 bytes in 3282 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:58:02 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e76ed318-f82e-4db1-b313-7a059a4fd955 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:02 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e76ed318-f82e-4db1-b313-7a059a4fd955 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:03 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e76ed318-f82e-4db1-b313-7a059a4fd955 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e76ed318-f82e-4db1-b313-7a059a4fd955 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 200 len: 1231 microversion: 2.1 time: 0.689063 Apr 21 13:58:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:02 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 1231 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1791477557", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "d567294b-c36b-4268-af90-17560e0c43e4"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:04 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] validate_networks() for [('d567294b-c36b-4268-af90-17560e0c43e4', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:05 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f700a109-5cdf-4d9a-b900-130dbadaed6d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Action: 'create', calling method: .version_select at 0x7f160eca5990>, body: {"keypair": {"name": "tempest-keypair-2134167482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSfCm4kaW8kKhEYk26quHUV0I+U7qCvNO4t2+x3r4VBiTtZqyaoR2EGTBvf5XEnA51qy75jGfzROX158wPVnPuLv0NMr8g0Jge5rbAgJLAI/7LXIqSONczhV0yG5arkdQ=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:05 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f700a109-5cdf-4d9a-b900-130dbadaed6d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:05 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f700a109-5cdf-4d9a-b900-130dbadaed6d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for user 92c19bad528a4c38860a43913b28b85b and project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:05 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f700a109-5cdf-4d9a-b900-130dbadaed6d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148067 Apr 21 13:58:05 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 18/49] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 13:58:05 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 13:58:06 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e6b60fe0-09d1-4f99-b1f7-c57a1b74fd5c tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Action: 'create', calling method: .version_select at 0x7f160ed01750>, body: {"keypair": {"name": "tempest-keypair-1535115748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkCCUCEByuZA8uefKTCCf6BwNOi3GFQvMJ7eA+GdJBuYKCUigOvF7jv5smuTcvHYLmZKP4LkvWhlc4WMHNO3mTFd+RXuNxX7VqhNcJysaZOOp2XhD7KgmsEEHk9+iiuvQ=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:06 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e6b60fe0-09d1-4f99-b1f7-c57a1b74fd5c tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Getting quotas for project b4c4270d6dfa435f94da018d12586bcd. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:06 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e6b60fe0-09d1-4f99-b1f7-c57a1b74fd5c tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Getting quotas for user 0d7d1e7446af4edf8e35a9d0178b2895 and project b4c4270d6dfa435f94da018d12586bcd. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:06 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e6b60fe0-09d1-4f99-b1f7-c57a1b74fd5c tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.475064 Apr 21 13:58:06 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 17/50] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:58:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Getting quotas for project a8c210480b33473c91156b798bcbd8b2. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Getting quotas for user 2259f365261c49b28b56ddd1c27c125d and project a8c210480b33473c91156b798bcbd8b2. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:07 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-62f86bb9-4153-428a-a29e-db14c94d2acb tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.319491 Apr 21 13:58:07 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 16/51] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:58:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 3323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:58:07 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-e38ee70a-7f6f-4683-87ae-0321e8f7394a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:07 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-e38ee70a-7f6f-4683-87ae-0321e8f7394a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:07 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-e38ee70a-7f6f-4683-87ae-0321e8f7394a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:07 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-e38ee70a-7f6f-4683-87ae-0321e8f7394a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1211 microversion: 2.1 time: 0.196574 Apr 21 13:58:07 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:07 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1211 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1376655679", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1815b48e-38a4-4a83-a23b-d7c2ce38a2c3"}], "security_groups": [{"name": "tempest-securitygroup--844891411"}], "key_name": "tempest-keypair-2134167482", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:11 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] validate_networks() for [('1815b48e-38a4-4a83-a23b-d7c2ce38a2c3', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Creating event network-changed:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ef629216-d3ae-4a2e-b261-647bb7637391 req-1ad568c2-4b76-488b-a793-512bb6e9abd2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:11 user devstack@n-api.service[61727]: INFO nova.compute.rpcapi [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 13:58:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 13:58:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-626a7431-d499-4fd2-8f82-a754756b0cb5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152101 Apr 21 13:58:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 17/53] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for user 92c19bad528a4c38860a43913b28b85b and project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:13 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:13 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b5b2956a-889c-4938-8fee-9018b295eb78 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.652261 Apr 21 13:58:13 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 18/54] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 13:58:11 2023] POST /compute/v2.1/servers => generated 399 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:13 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:13 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-405e14df-9b16-4809-8c2d-c6dd86288506 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 200 len: 1276 microversion: 2.20 time: 0.124747 Apr 21 13:58:13 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 13:58:13 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 13:58:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1149674532", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "43525cbd-9d02-4cd7-b457-b26a485106f5"}], "security_groups": [{"name": "tempest-securitygroup--1289743024"}], "key_name": "tempest-keypair-1535115748", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Creating event network-changed:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94919cc0-3609-4cec-a75a-da318d464e87 req-50e91cff-0571-459c-8434-ca5943581982 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:15 user devstack@n-api.service[61728]: INFO nova.compute.rpcapi [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 13:58:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] Releasing lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 13:58:15 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] validate_networks() for [('43525cbd-9d02-4cd7-b457-b26a485106f5', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7e514ef5-5608-453c-ad30-8f8ad54aa4ab None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427182 Apr 21 13:58:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 19/56] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Getting quotas for project b4c4270d6dfa435f94da018d12586bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Getting quotas for user 0d7d1e7446af4edf8e35a9d0178b2895 and project b4c4270d6dfa435f94da018d12586bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:17 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8a093d00-1bc2-45b6-a52a-203089bc997b tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.403906 Apr 21 13:58:17 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:58:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:58:17 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b9142d61-3e3a-42bb-bf86-4784275c46b4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:17 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b9142d61-3e3a-42bb-bf86-4784275c46b4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "name": "network-vif-plugged", "status": "completed", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:17 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-b9142d61-3e3a-42bb-bf86-4784275c46b4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d1e7446af4edf8e35a9d0178b2895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4270d6dfa435f94da018d12586bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:17 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b9142d61-3e3a-42bb-bf86-4784275c46b4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 200 len: 1240 microversion: 2.1 time: 0.308724 Apr 21 13:58:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:17 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 21/58] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:17 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 1240 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] Creating event network-vif-plugged:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:58:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-94b909ce-2c44-4a11-83aa-ef6f2ae1fb09 req-b1174765-d494-473c-9dc4-6c28e07f0b52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Apr 21 13:58:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:19 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "name": "network-vif-plugged", "status": "completed", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}, {"server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "name": "network-vif-plugged", "status": "completed", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}, {"server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "name": "network-vif-plugged", "status": "completed", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Creating event network-vif-plugged:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:58:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Creating event network-vif-plugged:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 13:58:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] Creating event network-vif-plugged:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 13:58:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-15037ced-8d60-4afa-84e0-ace82e2db0dc req-c5d054f7-a78c-45d5-9768-cc39a57f9fb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047506 Apr 21 13:58:19 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 19/60] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:19 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:20 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Creating event network-changed:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61726) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a1df6cef-89fa-4e75-b8e2-6a1cb2d948d4 req-5afb44c8-9c41-49f3-87a8-11844da88d2b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61726) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:20 user devstack@n-api.service[61726]: INFO nova.compute.rpcapi [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 13:58:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] Releasing lock "compute-rpcapi-router" {{(pid=61726) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 13:58:20 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a839d7b7-47d3-42f2-922e-e462acdf9905 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115239 Apr 21 13:58:20 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 22/61] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] Creating event network-changed:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 13:58:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-e59d1d6f-d37c-435f-acea-83d6a28200ed req-a1b114e2-4085-4f9e-8a34-1087e64ceac6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047673 Apr 21 13:58:23 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:24 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c2ce6683-6c54-4f5f-92be-07db68e543bb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Action: 'create', calling method: .version_select at 0x7f160ecd0700>, body: {"keypair": {"name": "tempest-keypair-198905762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1e308suG6Up9XacMAZI+/gRfmiDMDOuigLvKXnubV1WGNa08tjA4vufwk45vBBKQZeBxNXGuSgt+lX8T8X9YT0Q/e8fHr4reV0+dJepejAd/TWi7ALI+M/7BbZu2uxsg=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:24 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-c2ce6683-6c54-4f5f-92be-07db68e543bb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Getting quotas for project 1953479f081341b088eaecb8369fce0b. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:24 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-c2ce6683-6c54-4f5f-92be-07db68e543bb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Getting quotas for user 7ac1dc66f96249f884f9b4dbc73f37b4 and project 1953479f081341b088eaecb8369fce0b. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:24 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c2ce6683-6c54-4f5f-92be-07db68e543bb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.338114 Apr 21 13:58:24 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 20/63] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:58:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:24 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "name": "network-vif-plugged", "status": "completed", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:24 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] Creating event network-vif-plugged:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 13:58:24 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-20b9aa2d-fec6-42a1-a528-5827fd76c3bd req-e8412dd6-3366-4f1f-9814-3837067bfb61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175840 Apr 21 13:58:24 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=12 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "name": "network-vif-plugged", "status": "completed", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] Creating event network-vif-plugged:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 13:58:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-483d3b5c-66d1-4d67-8bbe-0bfe0ec70fb6 req-c9ba8c56-eac6-49d6-bb21-3eee67e4dcd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096699 Apr 21 13:58:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "name": "network-vif-plugged", "status": "completed", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] Creating event network-vif-plugged:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 13:58:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-13e6d233-7179-4e0b-882d-168d7cb0390d req-60bcda29-4bdd-48f0-a07c-48e18b379aa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037309 Apr 21 13:58:26 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 21/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 13:58:27 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=16 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:27 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-73f99df6-c4c1-4d76-832a-f4b866920f91 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Action: 'create', calling method: .version_select at 0x7f160ecf3760>, body: {"keypair": {"name": "tempest-keypair-1507777159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhmqZ33jzOJUNp5cIjTjD2V4mwqGnUNtzXSj78uvtldCN9y9LKEaKBdycKDs4VYN2v9RCyHrUj9yHjgYAuNS07yjzech5h1dSQg5dt5ELnEas6naL+mLGQFJzls0JQplQ=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:27 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-73f99df6-c4c1-4d76-832a-f4b866920f91 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:27 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-73f99df6-c4c1-4d76-832a-f4b866920f91 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for user b60caf53ee58417cb76a77c963a45ec2 and project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-73f99df6-c4c1-4d76-832a-f4b866920f91 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417313 Apr 21 13:58:27 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 24/67] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:58:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:28 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "name": "network-vif-plugged", "status": "completed", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:28 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:28 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:28 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] Creating event network-vif-plugged:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 13:58:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-1425732b-b125-42e3-8cdf-223d318841cb req-4089485a-cc91-474e-80ed-e30ace685c9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075092 Apr 21 13:58:28 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-704385804", "imageRef": "2be63a0e-17cf-4166-a64b-96ec2f419df8", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d373a2f1-e506-4b6b-ab93-37e77bb02c7a"}], "security_groups": [{"name": "tempest-securitygroup--1908702357"}], "key_name": "tempest-keypair-198905762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:29 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:29 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] validate_networks() for [('d373a2f1-e506-4b6b-ab93-37e77bb02c7a', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Getting quotas for project 1953479f081341b088eaecb8369fce0b. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Getting quotas for user 7ac1dc66f96249f884f9b4dbc73f37b4 and project 1953479f081341b088eaecb8369fce0b. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:30 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2be63a0e-17cf-4166-a64b-96ec2f419df8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:30 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-17eb390f-4076-448e-ae84-76f8d6c6c9fb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.294787 Apr 21 13:58:30 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 22/69] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:58:28 2023] POST /compute/v2.1/servers => generated 404 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:58:30 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:30 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-40e40e63-f40d-47f5-b6c3-267c6340756a tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:30 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-40e40e63-f40d-47f5-b6c3-267c6340756a tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:30 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:30 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-40e40e63-f40d-47f5-b6c3-267c6340756a tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac1dc66f96249f884f9b4dbc73f37b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1953479f081341b088eaecb8369fce0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:30 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-40e40e63-f40d-47f5-b6c3-267c6340756a tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 200 len: 1238 microversion: 2.1 time: 0.239551 Apr 21 13:58:30 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:30 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 1238 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1193021950", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "6e372a6f-6444-4977-be86-7a6bb86d8979"}], "security_groups": [{"name": "tempest-securitygroup--761696219"}], "key_name": "tempest-keypair-1507777159", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:30 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] validate_networks() for [('6e372a6f-6444-4977-be86-7a6bb86d8979', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for user b60caf53ee58417cb76a77c963a45ec2 and project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:33 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:33 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f07cda0b-1001-48a0-a9d3-d31e01d07db7 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.673290 Apr 21 13:58:33 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:58:30 2023] POST /compute/v2.1/servers => generated 403 bytes in 2675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:58:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1bc8c848-5027-4c3a-b25b-d71d3bd5dd1c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:33 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1bc8c848-5027-4c3a-b25b-d71d3bd5dd1c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:33 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-1bc8c848-5027-4c3a-b25b-d71d3bd5dd1c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1bc8c848-5027-4c3a-b25b-d71d3bd5dd1c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27" status: 200 len: 1236 microversion: 2.1 time: 0.151116 Apr 21 13:58:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 23/72] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:33 2023] GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 => generated 1236 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 13:58:35 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:35 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] Creating event network-changed:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 13:58:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-74b455e0-7701-4154-ae95-0af338dbf562 req-e1875212-9944-4326-8e0c-78427f4f566b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Apr 21 13:58:36 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:38 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:38 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] Creating event network-changed:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 13:58:38 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-9fa5d826-754e-4689-b155-f17041dcaf93 req-5272e368-89d6-4345-9812-2d41c4618f9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036544 Apr 21 13:58:38 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "name": "network-vif-plugged", "status": "completed", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}, {"server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "name": "network-vif-plugged", "status": "completed", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Creating event network-vif-plugged:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 13:58:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] Creating event network-vif-plugged:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 13:58:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7e1cfa8b-ea77-47d9-9b52-2847e9c7f57b req-947fed86-e757-4639-87f8-eb90acfcb709 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038684 Apr 21 13:58:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 13:58:41 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:42 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 13:58:42 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-980e8cb4-947e-49bc-9159-5d7301c4dd7b req-e2b01c8c-dbf0-4065-920c-76d03bd11fce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040268 Apr 21 13:58:42 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:44 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=19 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 13:58:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-3ab59224-4381-43b7-bc14-257e81ef3db4 req-6f334cc9-a1ba-43e3-9d4f-a53d0ef620a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053833 Apr 21 13:58:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:46 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=24 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-66fe4260-480f-4bc5-926d-b7979b5d3d05 tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] Action: 'create', calling method: .version_select at 0x7f160e336c20>, body: {"keypair": {"name": "tempest-TestShelveInstance-932572086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHMGNkeHlsnyDNUWB/JafG2Nd7XW9Z8OZT0k+/cqw+a9BlZoOp2Q+FKxL3xUMZUoSZYnigQS+jJmbB6gJUqbJftlEQ7aCeakARcOL8UcE2goNmTGbsLvIz5DFtTT+V0wA=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:46 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-66fe4260-480f-4bc5-926d-b7979b5d3d05 tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] Getting quotas for project f20a7306c12e4b409447d25a772b653c. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:46 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-66fe4260-480f-4bc5-926d-b7979b5d3d05 tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] Getting quotas for user 65032a53f43347c1a01116b69350666d and project f20a7306c12e4b409447d25a772b653c. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-66fe4260-480f-4bc5-926d-b7979b5d3d05 tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.356856 Apr 21 13:58:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 25/78] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:58:46 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-840f2303-31ce-4905-b3d0-a04bdb51129b tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Action: 'create', calling method: .version_select at 0x7f160ecf2f80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-683687260", "metadata": {"Type": "work"}}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-840f2303-31ce-4905-b3d0-a04bdb51129b tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61726]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Length: 121 Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: Apr 21 13:58:48 user devstack@n-api.service[61726]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-683687260", "metadata": {"Type": "work"}}} Apr 21 13:58:48 user devstack@n-api.service[61726]: method: Apr 21 13:58:48 user devstack@n-api.service[61726]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61726]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-683687260', 'metadata': {'Type': 'work'}}}} Apr 21 13:58:48 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise error Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi '#$%' Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-840f2303-31ce-4905-b3d0-a04bdb51129b tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-840f2303-31ce-4905-b3d0-a04bdb51129b tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.213236 Apr 21 13:58:48 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 28/79] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 13:58:47 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-98be6a84-86b7-4c3c-8471-a8a8954510d0 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Action: 'create', calling method: .version_select at 0x7f160e3009d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-350837558", "metadata": {"Type": "work"}}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-98be6a84-86b7-4c3c-8471-a8a8954510d0 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61728]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61728]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61728]: Content-Length: 119 Apr 21 13:58:48 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61728]: Apr 21 13:58:48 user devstack@n-api.service[61728]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-350837558", "metadata": {"Type": "work"}}} Apr 21 13:58:48 user devstack@n-api.service[61728]: method: Apr 21 13:58:48 user devstack@n-api.service[61728]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 13:58:48 user devstack@n-api.service[61728]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-350837558', 'metadata': {'Type': 'work'}}}} Apr 21 13:58:48 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise error Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi '0' Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-98be6a84-86b7-4c3c-8471-a8a8954510d0 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-98be6a84-86b7-4c3c-8471-a8a8954510d0 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015436 Apr 21 13:58:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 27/80] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 13:58:48 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b35781c9-7846-4916-bc40-d13388e2a980 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Action: 'create', calling method: .version_select at 0x7f160e337760>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1062236185", "metadata": {"Type": "work"}}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:48 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b35781c9-7846-4916-bc40-d13388e2a980 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61727]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61727]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61727]: Content-Length: 119 Apr 21 13:58:48 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61727]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61727]: Apr 21 13:58:48 user devstack@n-api.service[61727]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1062236185", "metadata": {"Type": "work"}}} Apr 21 13:58:48 user devstack@n-api.service[61727]: method: Apr 21 13:58:48 user devstack@n-api.service[61727]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61727]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1062236185', 'metadata': {'Type': 'work'}}}} Apr 21 13:58:48 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise error Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi '' Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 13:58:48 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b35781c9-7846-4916-bc40-d13388e2a980 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b35781c9-7846-4916-bc40-d13388e2a980 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012262 Apr 21 13:58:48 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 26/81] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 13:58:48 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-96139a09-9756-4baf-832f-4cc68949e64a tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Calling method '.version_select at 0x7f160e3412d0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-96139a09-9756-4baf-832f-4cc68949e64a tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] HTTP exception thrown: Volume tempest-invalid-1973243984 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-96139a09-9756-4baf-832f-4cc68949e64a tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61726]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1973243984 HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61726]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: method: Apr 21 13:58:48 user devstack@n-api.service[61726]: exception: Volume tempest-invalid-1973243984 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: action_args: {'id': 'tempest-invalid-1973243984'} Apr 21 13:58:48 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1973243984 could not be found. (HTTP 404) (Request-ID: req-07df4283-338e-4948-a09c-7788f85e12df) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1973243984 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1973243984 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1973243984 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-96139a09-9756-4baf-832f-4cc68949e64a tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 404 to user: Volume tempest-invalid-1973243984 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-96139a09-9756-4baf-832f-4cc68949e64a tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1973243984" status: 404 len: 99 microversion: 2.1 time: 0.069323 Apr 21 13:58:48 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 29/82] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 13:58:48 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1973243984 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e9b145f2-1ec5-447b-a317-b6b5c0756870 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005889 Apr 21 13:58:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 21 13:58:48 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-deed8e36-ca86-4f37-ac11-8416498bfe10 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004664 Apr 21 13:58:48 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 21 13:58:48 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-34f163e3-be0a-413c-96fa-c960632c60a5 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Calling method '.version_select at 0x7f160e3c27a0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-34f163e3-be0a-413c-96fa-c960632c60a5 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] HTTP exception thrown: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-34f163e3-be0a-413c-96fa-c960632c60a5 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61726]: request: DELETE /compute/v2.1/os-volumes/6791d3ed-8971-4f93-a21d-588b8a5054fe HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61726]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 13:58:48 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61726]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61726]: method: Apr 21 13:58:48 user devstack@n-api.service[61726]: exception: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: action_args: {'id': '6791d3ed-8971-4f93-a21d-588b8a5054fe'} Apr 21 13:58:48 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. (HTTP 404) (Request-ID: req-3062de83-1581-4551-81e7-52c8350a7fc4) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. Apr 21 13:58:48 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-34f163e3-be0a-413c-96fa-c960632c60a5 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 404 to user: Volume 6791d3ed-8971-4f93-a21d-588b8a5054fe could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-34f163e3-be0a-413c-96fa-c960632c60a5 tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6791d3ed-8971-4f93-a21d-588b8a5054fe" status: 404 len: 109 microversion: 2.1 time: 0.057603 Apr 21 13:58:48 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 13:58:48 2023] DELETE /compute/v2.1/os-volumes/6791d3ed-8971-4f93-a21d-588b8a5054fe => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-32c0e4a8-d328-41b8-abfc-c5c3632ef7fd tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Calling method '.version_select at 0x7f160e303880>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-32c0e4a8-d328-41b8-abfc-c5c3632ef7fd tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] HTTP exception thrown: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-32c0e4a8-d328-41b8-abfc-c5c3632ef7fd tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Request method failure captured: Apr 21 13:58:48 user devstack@n-api.service[61728]: request: GET /compute/v2.1/os-volumes/a1586489-94ba-48c4-bf30-e1fdb0b350d8 HTTP/1.1 Apr 21 13:58:48 user devstack@n-api.service[61728]: Accept: application/json Apr 21 13:58:48 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 13:58:48 user devstack@n-api.service[61728]: Connection: close Apr 21 13:58:48 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 13:58:48 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 13:58:48 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 13:58:48 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 13:58:48 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpaXWNWsB73CDmTV_8uf1OWvb7l8Y3OfZfCv-wBj1ZDPgdh62N6aElnLda2tjmV9rqjSBxFaAt4fDR_y-0EGnImkyDk30JENKoTI6RHjcY-g-Hv-0xjSStkDHgSal-uJn356fISjDkAKDBS7koZAG_QTpMnPhZO01KU3rvgLPLMWxHA Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5737dcf9364545429a43d468b8c488c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant-Id: 5737dcf9364545429a43d468b8c488c4 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesNegativeTest-2122076086 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Id: 485f2e90b22645f188c1c984d2395f80 Apr 21 13:58:48 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesNegativeTest-2122076086-project-member Apr 21 13:58:48 user devstack@n-api.service[61728]: method: Apr 21 13:58:48 user devstack@n-api.service[61728]: exception: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61728]: action_args: {'id': 'a1586489-94ba-48c4-bf30-e1fdb0b350d8'} Apr 21 13:58:48 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. (HTTP 404) (Request-ID: req-5a0215f7-a5e8-4bca-943a-1eada47ccc9f) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. Apr 21 13:58:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 13:58:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-32c0e4a8-d328-41b8-abfc-c5c3632ef7fd tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] Returning 404 to user: Volume a1586489-94ba-48c4-bf30-e1fdb0b350d8 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 13:58:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-32c0e4a8-d328-41b8-abfc-c5c3632ef7fd tempest-VolumesNegativeTest-2122076086 tempest-VolumesNegativeTest-2122076086-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a1586489-94ba-48c4-bf30-e1fdb0b350d8" status: 404 len: 109 microversion: 2.1 time: 0.069780 Apr 21 13:58:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 13:58:48 2023] GET /compute/v2.1/os-volumes/a1586489-94ba-48c4-bf30-e1fdb0b350d8 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 13:58:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-0e085d19-2a0e-45e7-95c0-dba60992671d tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] Calling method '.version_select at 0x7f160e337d00>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:50 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-0e085d19-2a0e-45e7-95c0-dba60992671d tempest-TestShelveInstance-1548259791 tempest-TestShelveInstance-1548259791-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-932572086" status: 202 len: 0 microversion: 2.1 time: 0.023801 Apr 21 13:58:50 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 28/87] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 21 13:58:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-932572086 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=7 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:53 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:53 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-2fdc9f3d-829f-4de3-8fdc-855cd4fd3ec8 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 200 len: 1535 microversion: 2.1 time: 0.488638 Apr 21 13:58:53 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 31/88] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:53 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 1535 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1731146767", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "4b38afb7-2b53-44fc-a4e0-7d79bef71734"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:54 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] validate_networks() for [('4b38afb7-2b53-44fc-a4e0-7d79bef71734', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for user 132913991f8c45c1adaf5db7ef7cea30 and project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:58:55 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:58:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bca69c3f-1b50-450e-9cdf-a479ba0551d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.471584 Apr 21 13:58:55 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 30/89] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 13:58:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f7a33192-29fb-408a-aae2-ad2baf4b0a50 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 200 len: 1395 microversion: 2.87 time: 0.111619 Apr 21 13:58:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 29/90] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 13:58:55 2023] GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 1395 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:58:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:58:58 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:58:58 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-fc3d463a-cce6-4586-a678-1983a46c41a6 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1494 microversion: 2.1 time: 0.411653 Apr 21 13:58:58 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 32/91] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:58:57 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1494 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:58:59 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1763512323", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "d4871732-c28b-456f-8efe-8f0c46a4107d"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:58:59 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] validate_networks() for [('d4871732-c28b-456f-8efe-8f0c46a4107d', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Getting quotas for project f4add6cbbd424513a25dacd5dfb3adcf. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Getting quotas for user f09a36fbec134e248aa2baec4bb6a53b and project f4add6cbbd424513a25dacd5dfb3adcf. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:59:00 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:59:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] Creating event network-changed:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 13:59:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-567602ec-fc22-4868-8d78-2aa2edca2bc6 req-d4761816-a121-4666-9059-511e1db521e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037984 Apr 21 13:59:00 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 30/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 13:59:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4be3eed1-17a5-4293-95fa-755d3d308c32 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.868418 Apr 21 13:59:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:58:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:59:00 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-0d337c4b-a452-46f4-a3b7-39aab6254eeb tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:00 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-0d337c4b-a452-46f4-a3b7-39aab6254eeb tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:00 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-0d337c4b-a452-46f4-a3b7-39aab6254eeb tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09a36fbec134e248aa2baec4bb6a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4add6cbbd424513a25dacd5dfb3adcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:00 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-0d337c4b-a452-46f4-a3b7-39aab6254eeb tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b" status: 200 len: 1209 microversion: 2.1 time: 0.069985 Apr 21 13:59:00 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:00 2023] GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b => generated 1209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "name": "network-vif-plugged", "status": "completed", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] Creating event network-vif-plugged:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 13:59:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-6a68e961-30e1-45ff-9be3-b3e77b40c2d5 req-22bdd158-63fe-4ee6-aaf4-9efce6808d02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Apr 21 13:59:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:03 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] Creating event network-changed:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 13:59:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-e0f6489f-531b-487d-8bec-ae54425a1ac1 req-8b1e8319-8def-4180-8bd3-a808e280cf1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035211 Apr 21 13:59:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:04 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:04 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:04 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:04 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-acd75110-97db-49e1-854b-24a270c9be05 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 200 len: 1588 microversion: 2.20 time: 0.255650 Apr 21 13:59:04 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 34/97] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 13:59:03 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 1588 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 13:59:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "name": "network-vif-plugged", "status": "completed", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] Creating event network-vif-plugged:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 13:59:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-40ebf43c-0d36-455a-8a45-71e2cd2ddeff req-e205e987-6418-4b7f-9188-d07fb5eb01bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Apr 21 13:59:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:05 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "name": "network-vif-plugged", "status": "completed", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:05 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=9 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] Creating event network-vif-plugged:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 13:59:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-957327f2-9111-40c6-8d73-54a25d279800 req-c4c3de66-0b2a-4a20-b403-6ea82d920d01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050101 Apr 21 13:59:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:07 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "name": "network-vif-plugged", "status": "completed", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:07 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:07 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:07 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:07 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] Creating event network-vif-plugged:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 13:59:07 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-d6f64c58-d271-4231-8d85-13b0a3832416 req-14a5fbc1-635d-49e2-b9e2-ac36e73309c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043632 Apr 21 13:59:07 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 35/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:07 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d1e7446af4edf8e35a9d0178b2895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4270d6dfa435f94da018d12586bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f2a812fa-0dfd-4512-8f0a-01fbca8d3bc4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 200 len: 1554 microversion: 2.1 time: 0.381621 Apr 21 13:59:07 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:07 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 1554 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:18 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:18 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=12 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:18 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:18 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:19 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e9ac9974-84ac-4487-8fc1-f110fba77756 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Action: 'create', calling method: .version_select at 0x7f160e3ca7a0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1470211823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR10aEOjapD46pprj3PVJ6Gx5H8VQYM8ILWN6S/kFyLgzYn0q969VADuMdlZwliZmFRI4vN1i/LRJPIe9UBMJ19tPqMq6iASFPFIt5SbKZXfihMoI1E5AGB6AltaW1bLw=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:19 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e9ac9974-84ac-4487-8fc1-f110fba77756 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Getting quotas for project 9daf036d4ad84586a628c454408e3d7d. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:59:19 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e9ac9974-84ac-4487-8fc1-f110fba77756 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Getting quotas for user 1a2438d69a684df69e1de2edddc73bc0 and project 9daf036d4ad84586a628c454408e3d7d. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:59:19 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e9ac9974-84ac-4487-8fc1-f110fba77756 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.269605 Apr 21 13:59:19 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 13:59:18 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=12 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=20 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-781003247", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1470211823", "security_groups": [{"name": "tempest-secgroup-smoke-2053846956"}], "networks": [{"uuid": "ee3596e4-eb99-458a-b7ae-a48f8bcd58c7"}]}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] validate_networks() for [('ee3596e4-eb99-458a-b7ae-a48f8bcd58c7', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Getting quotas for project 9daf036d4ad84586a628c454408e3d7d. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Getting quotas for user 1a2438d69a684df69e1de2edddc73bc0 and project 9daf036d4ad84586a628c454408e3d7d. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:59:20 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:59:21 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-24e973b0-80b8-4b41-9408-f21918bcef13 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.597347 Apr 21 13:59:21 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 36/103] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:59:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:59:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c872a6b4-7103-4399-828a-d99a0c682b82 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c872a6b4-7103-4399-828a-d99a0c682b82 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac1dc66f96249f884f9b4dbc73f37b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1953479f081341b088eaecb8369fce0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-115cf304-50bf-4111-a6c0-2fd26dba766f tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 200 len: 1548 microversion: 2.1 time: 0.430130 Apr 21 13:59:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:20 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 1548 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:21 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c872a6b4-7103-4399-828a-d99a0c682b82 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2438d69a684df69e1de2edddc73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9daf036d4ad84586a628c454408e3d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c872a6b4-7103-4399-828a-d99a0c682b82 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 200 len: 1256 microversion: 2.1 time: 0.072415 Apr 21 13:59:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:21 2023] GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 1256 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:23 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:23 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] Creating event network-changed:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 13:59:23 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-6cf601c3-6d56-4beb-84bf-0900cee834ed req-d9808f4f-e109-42f3-9a30-46d844824189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031552 Apr 21 13:59:23 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 37/106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:23 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7556c333-8df2-4010-a1fd-b7450c7f6587 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27" status: 200 len: 1545 microversion: 2.1 time: 0.381866 Apr 21 13:59:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:23 2023] GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 => generated 1545 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:25 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "name": "network-vif-plugged", "status": "completed", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] Creating event network-vif-plugged:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 13:59:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-c434ff41-92fa-40e6-93a5-1fc0933f1d4e req-30c75858-3f81-40a7-9c34-e5ebe0986d0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Apr 21 13:59:25 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:27 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "name": "network-vif-plugged", "status": "completed", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] Creating event network-vif-plugged:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 13:59:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-4cfbdf1a-f4a5-41e0-ae99-fe0194372c7f req-4956e735-b216-4160-9af5-f056414a6baf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029167 Apr 21 13:59:27 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 38/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:45 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8bd87b0e-00fa-4c6f-9383-933b28076f91 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 200 len: 1691 microversion: 2.87 time: 0.279268 Apr 21 13:59:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 36/110] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 13:59:45 2023] GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:50 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09a36fbec134e248aa2baec4bb6a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4add6cbbd424513a25dacd5dfb3adcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-cafe9782-b441-4a45-b209-3b9765f033ce tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b" status: 200 len: 1489 microversion: 2.1 time: 0.325742 Apr 21 13:59:50 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:50 2023] GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b => generated 1489 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:54 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-0992bbe1-8bdc-4da3-836a-15e78230bd36 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.203511 Apr 21 13:59:54 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 39/112] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 13:59:53 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73/os-interface => generated 282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] Creating event network-changed:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:59:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-167b475a-c901-4188-90c8-0523071cb637 req-114f30a0-8919-47e3-9e39-2fe804ce950e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050413 Apr 21 13:59:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:55 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bf3c441d-0134-4ee8-a373-17d12962acfe tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73/ips" status: 200 len: 103 microversion: 2.1 time: 0.130617 Apr 21 13:59:55 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 13:59:55 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73/ips => generated 103 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:57 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 13:59:57 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-c4f11915-a906-4840-8ced-dcca73a601c9 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 204 len: 0 microversion: 2.1 time: 0.129576 Apr 21 13:59:57 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 40/115] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 13:59:57 2023] DELETE /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:57 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "name": "network-vif-unplugged", "status": "completed", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:57 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:57 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4f4071c6-40d8-4568-bc26-e156213782f2 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 200 len: 1660 microversion: 2.1 time: 0.244511 Apr 21 13:59:57 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:57 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 1660 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:57 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:57 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:57 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:57 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] Creating event network-vif-unplugged:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:59:57 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-a33506a8-9e3e-49f5-ba91-00730b26b208 req-c346b146-d722-4efa-9424-6dce98b6622d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035200 Apr 21 13:59:57 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-911731909", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "d567294b-c36b-4268-af90-17560e0c43e4"}]}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] validate_networks() for [('d567294b-c36b-4268-af90-17560e0c43e4', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Getting quotas for project a8c210480b33473c91156b798bcbd8b2. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Getting quotas for user 2259f365261c49b28b56ddd1c27c125d and project a8c210480b33473c91156b798bcbd8b2. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 13:59:58 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 13:59:58 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f21ca4f8-fbbd-46c9-9803-27be1a10234a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.725300 Apr 21 13:59:58 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 41/118] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 13:59:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 13:59:59 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8902b76e-1609-4670-8506-16dcfb852c4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 13:59:59 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8902b76e-1609-4670-8506-16dcfb852c4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 13:59:59 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "name": "network-vif-deleted", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:59 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] Creating event network-vif-deleted:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:59:59 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-5f5ceafd-d108-4c6e-801c-c5410b4dd8dc req-05f55f2f-e32a-45e2-81e5-d1cba93dfe76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028767 Apr 21 13:59:59 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 13:59:59 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8902b76e-1609-4670-8506-16dcfb852c4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 13:59:59 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8902b76e-1609-4670-8506-16dcfb852c4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 200 len: 1210 microversion: 2.1 time: 0.078478 Apr 21 13:59:59 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 39/120] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 13:59:59 2023] GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 13:59:59 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5030decd-cbe5-4495-b497-dfacf25eef73", "name": "network-vif-plugged", "status": "completed", "tag": "ed62554b-cbc2-4c0f-ad1a-821a0625a2e4"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 13:59:59 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 13:59:59 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 13:59:59 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 13:59:59 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] Creating event network-vif-plugged:ed62554b-cbc2-4c0f-ad1a-821a0625a2e4 for instance 5030decd-cbe5-4495-b497-dfacf25eef73 on user Apr 21 13:59:59 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-ba0cab32-9c77-4d9d-86ae-dae006a8cdb1 req-c9ec8107-580f-4d6e-88ec-82eec995e174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032470 Apr 21 13:59:59 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 42/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 13:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] Creating event network-changed:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:00:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-30931b37-0ba1-4300-9804-71b1f6b8847c req-4200a501-d343-4249-a59e-e42358e06751 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028803 Apr 21 14:00:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:03 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "name": "network-vif-plugged", "status": "completed", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] Creating event network-vif-plugged:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:00:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-772ba3dd-559d-46d3-913f-bf163cdb07b9 req-a21eea64-0533-4cb5-b7c1-2958dc231363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029324 Apr 21 14:00:03 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 40/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:04 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:04 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-58bf65f0-3242-4e4e-9d49-5a09b685f4ff tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.153959 Apr 21 14:00:04 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 43/124] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 14:00:04 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c/os-interface => generated 283 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3887db73-e0d1-47f6-9ef4-622f87ba93a8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c/ips" status: 200 len: 111 microversion: 2.20 time: 0.037063 Apr 21 14:00:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 42/125] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 14:00:05 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c/ips => generated 111 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:00:05 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "name": "network-vif-plugged", "status": "completed", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}, {"name": "network-changed", "server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Creating event network-vif-plugged:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:00:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] Creating event network-changed:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 14:00:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-b6d73f1e-714e-4aa2-8983-fc01914ce65e req-9990db50-8e45-462b-9330-228df2e567bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037232 Apr 21 14:00:05 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:06 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:00:06 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-57a368e6-073e-42b3-a8d7-ca128f00c847 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 204 len: 0 microversion: 2.20 time: 0.127834 Apr 21 14:00:06 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 44/127] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:00:06 2023] DELETE /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:06 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:07 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:07 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:07 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:07 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-82a285a7-e03c-428c-9e46-ac225c54da51 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 200 len: 1712 microversion: 2.20 time: 0.215920 Apr 21 14:00:07 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 43/128] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:00:06 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 1712 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:00:07 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "name": "network-vif-unplugged", "status": "completed", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] Creating event network-vif-unplugged:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 14:00:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a584e436-5f77-4e9d-9720-e8cd8c12a115 req-7838eb0f-0194-4bbc-954b-d7a83e418f89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034743 Apr 21 14:00:07 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 42/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:08 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:08 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4220a418-2538-4cbd-b343-6cad684b7912 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.283278 Apr 21 14:00:08 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 45/130] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:00:08 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68/os-interface => generated 282 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "name": "network-vif-deleted", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] Creating event network-vif-deleted:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 14:00:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-9c9bd7aa-7f92-4917-afa4-d51912f2a238 req-4ca208d8-81b4-4aaa-bbab-be9bbfaa47e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275366 Apr 21 14:00:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:09 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:09 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af27bc9-9617-44c7-bfa4-993b347d183c", "name": "network-vif-plugged", "status": "completed", "tag": "7e465dfa-8ae6-4806-b18d-e23dcbf0a97d"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] Creating event network-vif-plugged:7e465dfa-8ae6-4806-b18d-e23dcbf0a97d for instance 3af27bc9-9617-44c7-bfa4-993b347d183c on user Apr 21 14:00:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-f45994ca-b6d3-4741-86dc-a25cffbf5ee9 req-9ff5da09-0002-459c-a0a3-7777e0ed3db2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030959 Apr 21 14:00:09 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1492085063"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:10 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a71ae1a7-085f-48bc-afd6-68c22df54e9e tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68/action" status: 202 len: 0 microversion: 2.1 time: 0.808212 Apr 21 14:00:10 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 46/133] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 14:00:09 2023] POST /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 21 14:00:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-a7c80eb4-6265-44f4-abf2-ae7f27d887ab tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '.version_select at 0x7f160f53ed40>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-a7c80eb4-6265-44f4-abf2-ae7f27d887ab tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf" status: 200 len: 1611 microversion: 2.1 time: 0.315191 Apr 21 14:00:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 45/134] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 14:00:10 2023] GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf => generated 1611 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:11 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] Creating event network-changed:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 14:00:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-5ac8ea38-8363-4a64-87ae-a9ce26808ce0 req-7ea1ed57-fc22-4321-8986-94082e710fd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049173 Apr 21 14:00:11 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 47/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:11 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2438d69a684df69e1de2edddc73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9daf036d4ad84586a628c454408e3d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e61b2b8b-93a7-49c1-aa42-c8330129ab77 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 200 len: 1569 microversion: 2.1 time: 0.286376 Apr 21 14:00:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 44/136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:11 2023] GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 1569 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=28 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3fa0246e-7355-446f-9bd2-bef721af1e8d tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.171074 Apr 21 14:00:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 46/137] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:00:21 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce/os-interface => generated 283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] Creating event network-changed:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 14:00:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-174db664-3469-47d4-adc8-28aac86fc9b5 req-2bf520a9-4ab3-41f1-975a-725f1c32da6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040193 Apr 21 14:00:22 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 48/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=22 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=28 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:00:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1879b097-5784-4ece-9263-c4c4f51fdb95 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 204 len: 0 microversion: 2.1 time: 0.245105 Apr 21 14:00:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 45/139] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:00:23 2023] DELETE /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "name": "network-vif-unplugged", "status": "completed", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] Creating event network-vif-unplugged:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 14:00:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-8121df1a-05b1-4cc5-9aaa-2538fa25e41a req-611760fb-7d2f-426c-812d-75ad4602e477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032747 Apr 21 14:00:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:00:24 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ac1dc66f96249f884f9b4dbc73f37b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1953479f081341b088eaecb8369fce0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ac90a7ca-7f6c-4148-abc1-9b183ecb104e tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 200 len: 1673 microversion: 2.1 time: 0.328363 Apr 21 14:00:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:23 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 1673 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:24 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-195131f6-d2a6-4e76-b103-b7b15fdc8f8c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.208308 Apr 21 14:00:24 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:00:23 2023] GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27/os-interface => generated 282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] Creating event network-changed:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:00:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-5934d589-a1d9-465d-b5db-73dfaa6604c3 req-59ce05cd-0940-4711-9c7c-5fb7fc472bdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032301 Apr 21 14:00:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:25 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "name": "network-vif-plugged", "status": "completed", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}, {"server_uuid": "0346fbd8-64cd-45e7-906f-e00eeece91ce", "name": "network-vif-deleted", "tag": "94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Creating event network-vif-plugged:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 14:00:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] Creating event network-vif-deleted:94bfdf6c-66ef-44cc-ab29-c1b1597cf6a8 for instance 0346fbd8-64cd-45e7-906f-e00eeece91ce on user Apr 21 14:00:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-03956135-7234-4666-8b45-7633822ed831 req-57c24df2-0e78-48f3-8b63-cc318b4e82a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031161 Apr 21 14:00:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:26 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-570817423", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "6e372a6f-6444-4977-be86-7a6bb86d8979"}]}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:26 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] validate_networks() for [('6e372a6f-6444-4977-be86-7a6bb86d8979', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Getting quotas for user b60caf53ee58417cb76a77c963a45ec2 and project 15f83d6d2c3049e9ba1ac7f04ad2ebb0. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:00:27 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:00:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f4e02dfc-bca3-4a98-a8c3-d3a7a4c3c6ae tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.528738 Apr 21 14:00:27 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 50/145] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:00:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:00:27 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8ea19b05-8c6c-4460-8c68-d20a2eabb7de tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:27 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8ea19b05-8c6c-4460-8c68-d20a2eabb7de tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:27 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8ea19b05-8c6c-4460-8c68-d20a2eabb7de tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8ea19b05-8c6c-4460-8c68-d20a2eabb7de tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa" status: 200 len: 1211 microversion: 2.1 time: 0.073479 Apr 21 14:00:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:27 2023] GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:29 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:29 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] Creating event network-changed:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:00:29 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-ff75b5d5-7fa9-4462-bffa-6ca45e199d0a req-b7c6e3b5-976a-4318-9daf-f9db39dc7a72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029353 Apr 21 14:00:29 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:32 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "name": "network-vif-plugged", "status": "completed", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:32 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:32 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:32 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:32 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] Creating event network-vif-plugged:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:00:32 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-3409afc9-ec49-4599-9b0b-6f74bde02ab3 req-cd644b12-4abb-4732-aefe-92703cd5dc4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029974 Apr 21 14:00:32 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 51/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "name": "network-vif-plugged", "status": "completed", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] Creating event network-vif-plugged:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:00:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-062ed02e-497c-417a-a41c-3035fd63bca1 req-1a776488-cbe6-498c-9aa3-4b6e06489013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031666 Apr 21 14:00:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=14 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2015965014"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:46 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f3ece249-25a0-494e-9f7d-dc3c1beb613c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5/action" status: 202 len: 52 microversion: 2.87 time: 0.782442 Apr 21 14:00:46 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 50/150] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 14:00:45 2023] POST /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5/action => generated 52 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=10 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:47 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:00:47 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 HTTP/1.1 Apr 21 14:00:47 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:00:47 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:00:47 user devstack@n-api.service[61726]: Connection: close Apr 21 14:00:47 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:00:47 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:00:47 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:00:47 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:00:47 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:00:47 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:00:47 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:00:47 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:00:47 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:00:47 user devstack@n-api.service[61726]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:00:47 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:00:47 user devstack@n-api.service[61726]: method: > Apr 21 14:00:47 user devstack@n-api.service[61726]: exception: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:00:47 user devstack@n-api.service[61726]: action_args: {'id': '5030decd-cbe5-4495-b497-dfacf25eef73'} Apr 21 14:00:47 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:00:47 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:47 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:00:47 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-3195e633-e025-4a96-aaaf-0995eb2b9a82 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 404 len: 111 microversion: 2.1 time: 0.043324 Apr 21 14:00:47 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 52/151] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:47 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:00:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:00:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3c11f6ca-fb85-477d-8ae7-b0b36b37077d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '.version_select at 0x7f160e334820>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-3c11f6ca-fb85-477d-8ae7-b0b36b37077d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234083121" status: 202 len: 0 microversion: 2.1 time: 0.036149 Apr 21 14:00:47 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:00:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234083121 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:00:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-eaeae521-1582-40bb-8381-b258b3e92dac tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Action: 'create', calling method: .version_select at 0x7f160e3cb1c0>, body: {"keypair": {"name": "tempest-keypair-1493985608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYfx0D/9HI6dRD4wXlpAeizOIf9VmC7glu2drchWSBPGsmZxukl0JKQLSPBGvOnDZea9iBw8HpwJNLK6oFXfEHEkUs1WkQz/KQVrF/Jrc/AnOokiNeEKYxBPPCAEmxZ0Q=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:48 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-eaeae521-1582-40bb-8381-b258b3e92dac tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for project 91f5972380fd48eabffd46e6727239ce. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:00:48 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-eaeae521-1582-40bb-8381-b258b3e92dac tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for user 113884844de14ec7ac8a20ba06a389b3 and project 91f5972380fd48eabffd46e6727239ce. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:00:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-eaeae521-1582-40bb-8381-b258b3e92dac tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047681 Apr 21 14:00:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 51/153] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:00:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:49 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-035ba900-f115-44a5-8855-0b2f0bbbb3ed tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 200 len: 1493 microversion: 2.1 time: 0.232297 Apr 21 14:00:49 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 53/154] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:49 2023] GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 1493 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2136406868", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "23a0f330-371d-4fe5-befe-bc4147bf09c7"}], "security_groups": [{"name": "tempest-securitygroup--1603766611"}], "key_name": "tempest-keypair-1493985608", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] validate_networks() for [('23a0f330-371d-4fe5-befe-bc4147bf09c7', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:51 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for project 91f5972380fd48eabffd46e6727239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:00:51 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Getting quotas for user 113884844de14ec7ac8a20ba06a389b3 and project 91f5972380fd48eabffd46e6727239ce. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:00:51 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:00:51 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:00:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-994d5aa4-e395-4df9-89da-ce7ccd7d4464 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.612528 Apr 21 14:00:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:00:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:00:51 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e0e6e6a8-b4db-4b24-8c26-58751317be90 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:51 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e0e6e6a8-b4db-4b24-8c26-58751317be90 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:51 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e0e6e6a8-b4db-4b24-8c26-58751317be90 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e0e6e6a8-b4db-4b24-8c26-58751317be90 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 200 len: 1232 microversion: 2.1 time: 0.067466 Apr 21 14:00:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 52/156] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:51 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 1232 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-6e8257d9-741f-4ddc-803d-83ba6c1ef25d tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 200 len: 1691 microversion: 2.87 time: 0.455987 Apr 21 14:00:52 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 54/157] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:00:51 2023] GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 1691 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:00:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e11dd171-27dc-4819-b654-49d63347a914 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b" status: 204 len: 0 microversion: 2.1 time: 0.139167 Apr 21 14:00:52 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:00:52 2023] DELETE /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "name": "network-vif-unplugged", "status": "completed", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] Creating event network-vif-unplugged:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 14:00:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-4b614965-5cfa-4604-bf93-70cf202b8a94 req-8979c528-687c-43e2-b350-b9a394ef7192 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029838 Apr 21 14:00:52 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 55/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:53 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09a36fbec134e248aa2baec4bb6a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4add6cbbd424513a25dacd5dfb3adcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:00:53 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-010419b6-4d0b-4f59-adba-ca0886202e99 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b" status: 200 len: 1495 microversion: 2.1 time: 0.532118 Apr 21 14:00:53 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:00:52 2023] GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b => generated 1495 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:00:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] Creating event network-changed:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:00:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-84a07417-c219-4078-8117-555e40733684 req-6b8ed968-67b8-4086-a487-378fb1e9246b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032032 Apr 21 14:00:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:54 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "name": "network-vif-deleted", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:54 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:54 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:54 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:54 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] Creating event network-vif-deleted:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 14:00:54 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-8fa92328-d77e-4109-a8f7-9f12bb3a5dad req-edcb7560-07d4-4e12-bf96-a1a874ae093a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028757 Apr 21 14:00:54 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 56/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90591d9b-6d6b-4f22-a3dc-fd83044df26b", "name": "network-vif-plugged", "status": "completed", "tag": "806c5236-f27a-4616-9ec6-85a2585f753a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] Creating event network-vif-plugged:806c5236-f27a-4616-9ec6-85a2585f753a for instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b on user Apr 21 14:00:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-fee52047-f0ca-44ad-8acc-e493ef81b5de req-435c6ccd-bce8-4faa-84a1-5bbccbc19e41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056224 Apr 21 14:00:55 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:00:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-df134d11-aa77-4544-87ac-879e60e335d5 req-e8b01452-dc2f-48d9-b58f-173d19293fb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047973 Apr 21 14:00:56 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:57 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:00:57 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c HTTP/1.1 Apr 21 14:00:57 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:00:57 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:00:57 user devstack@n-api.service[61726]: Connection: close Apr 21 14:00:57 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:00:57 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:00:57 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:00:57 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:00:57 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:00:57 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:00:57 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:00:57 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:00:57 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:00:57 user devstack@n-api.service[61726]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:00:57 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:00:57 user devstack@n-api.service[61726]: method: > Apr 21 14:00:57 user devstack@n-api.service[61726]: exception: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:00:57 user devstack@n-api.service[61726]: action_args: {'id': '3af27bc9-9617-44c7-bfa4-993b347d183c'} Apr 21 14:00:57 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:00:57 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:00:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:00:57 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-3f6145d7-ea11-49d5-9af7-434b5b279ca8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 404 len: 111 microversion: 2.20 time: 0.026762 Apr 21 14:00:57 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 57/165] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:00:57 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:00:57 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6d76c379-a4b0-4d17-ab3a-2987d01f0013 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '.version_select at 0x7f160e28b1c0>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:00:57 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6d76c379-a4b0-4d17-ab3a-2987d01f0013 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134167482" status: 204 len: 0 microversion: 2.20 time: 0.027115 Apr 21 14:00:57 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 55/166] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 21 14:00:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134167482 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:00:57 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-44958566-864a-4620-bf42-6be172a8f85a tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Action: 'create', calling method: .version_select at 0x7f160e337f40>, body: {"keypair": {"name": "tempest-keypair-33325504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjLzbn3Rtk7UAvXNCb/CqU3NFzUWrQkjNzooEbdsk7L34/ttrJQbQ8G2+mwvgH50DTejh2ROEqL19gr64B+vVPiL7Dti7Dkj0m8tNJC6vM/rbQizA3VE78YsalZDJlEwQ=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:57 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-44958566-864a-4620-bf42-6be172a8f85a tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:00:57 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-44958566-864a-4620-bf42-6be172a8f85a tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for user 92c19bad528a4c38860a43913b28b85b and project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:00:57 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-44958566-864a-4620-bf42-6be172a8f85a tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.042534 Apr 21 14:00:57 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 55/167] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 14:00:57 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 14:00:58 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:58 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:00:58 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-80e5a461-559e-4438-9c8c-cb9adc53241b req-6bbdabfe-0211-479b-a8c4-5a7d07a0d89c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048249 Apr 21 14:00:58 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 58/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1998626577", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1815b48e-38a4-4a83-a23b-d7c2ce38a2c3"}], "security_groups": [{"name": "tempest-securitygroup--1745362081"}], "key_name": "tempest-keypair-33325504", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] validate_networks() for [('1815b48e-38a4-4a83-a23b-d7c2ce38a2c3', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Getting quotas for user 92c19bad528a4c38860a43913b28b85b and project 8a8fedc10f324a92aef4142ab7efdd6a. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:00:59 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:01:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-8f553bc4-f568-4262-b1a2-e63718ffed39 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.628064 Apr 21 14:01:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 56/169] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 14:00:59 2023] POST /compute/v2.1/servers => generated 400 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 14:01:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:00 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:00 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:00 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:00 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a2452ec5-8594-4501-8523-79c5b6de624e tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 200 len: 1274 microversion: 2.20 time: 0.096311 Apr 21 14:01:00 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:01:00 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:01:01 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-d5c5fc7d-2386-435f-9fc1-f66923d27d72 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '.version_select at 0x7f160e2f27a0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:01 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-d5c5fc7d-2386-435f-9fc1-f66923d27d72 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf" status: 200 len: 1725 microversion: 2.1 time: 0.059071 Apr 21 14:01:01 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 59/171] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 14:01:01 2023] GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf => generated 1725 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-40c120ac-7568-4f7e-97be-69a0a2ebd6d4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '.version_select at 0x7f160e288af0>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-40c120ac-7568-4f7e-97be-69a0a2ebd6d4 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf" status: 200 len: 1725 microversion: 2.1 time: 0.062575 Apr 21 14:01:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 14:01:01 2023] GET /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf => generated 1725 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:01 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d1e7446af4edf8e35a9d0178b2895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4270d6dfa435f94da018d12586bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-788b8a56-bf8b-4c37-85f7-9ab6f12bbdbc tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 200 len: 1673 microversion: 2.1 time: 0.250905 Apr 21 14:01:01 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:01 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:03 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] Creating event network-changed:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:01:03 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-5c6a19ca-20ca-4a96-a8e2-03e5139aa169 req-c83b51ab-2a45-40f7-bf88-000e083f48a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Apr 21 14:01:03 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 60/174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:05 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "name": "network-vif-plugged", "status": "completed", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] Creating event network-vif-plugged:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:01:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-429c97e4-3e6a-4cc7-abf0-c5bb85f74e45 req-10e1e4a5-ef94-4790-8b8c-c3c552f19886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069863 Apr 21 14:01:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 58/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:07 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "name": "network-vif-plugged", "status": "completed", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] Creating event network-vif-plugged:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:01:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-df47348b-390d-4241-854d-c98948b2823d req-ee1cc8f4-507a-4865-84a7-83514cd8fd64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027514 Apr 21 14:01:07 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:11 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2438d69a684df69e1de2edddc73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9daf036d4ad84586a628c454408e3d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-bb728bc4-2ea8-40dd-9a0d-fe85febe3042 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 200 len: 1569 microversion: 2.1 time: 0.212199 Apr 21 14:01:11 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 61/177] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:11 2023] GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=12 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:13 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:01:13 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-16397692-199a-407a-b8c2-80319b74e6a3 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 204 len: 0 microversion: 2.1 time: 0.128065 Apr 21 14:01:13 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 59/178] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:01:13 2023] DELETE /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:13 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2438d69a684df69e1de2edddc73bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9daf036d4ad84586a628c454408e3d7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-ccc3636e-267d-4bb2-82aa-abcaa920c31a tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 200 len: 1575 microversion: 2.1 time: 0.374763 Apr 21 14:01:13 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:13 2023] GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 1575 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:13 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "name": "network-vif-unplugged", "status": "completed", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:13 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:13 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:13 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:13 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] Creating event network-vif-unplugged:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 14:01:13 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-98983001-48b2-4c6d-9a66-b56b1e070c2f req-d3c2eaf0-680e-4c70-9c7e-0929520cf779 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058651 Apr 21 14:01:13 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 62/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] HTTP exception thrown: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Request method failure captured: Apr 21 14:01:14 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce HTTP/1.1 Apr 21 14:01:14 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:01:14 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:01:14 user devstack@n-api.service[61728]: Connection: close Apr 21 14:01:14 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:01:14 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:01:14 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:01:14 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:01:14 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZp64qM8y4VKmQ5YwcQuy2Uqo4BXR2iCKtiWpFZk5v5artGP9JkSGCt-QTfEDu9yv9P_WcG9q26zARz_KYMDrfcjwOVlO1KqS1mMt0qKupgF6OkxT2D4ftQO3ABkFtcZRlhIMhUhiU6r06tOXL_awbHyuWkO0N2pIGqN-rkrLONhR4 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Project-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1953479f081341b088eaecb8369fce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Tenant-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:14 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-User: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:14 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:01:14 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:01:14 user devstack@n-api.service[61728]: X-User-Id: 7ac1dc66f96249f884f9b4dbc73f37b4 Apr 21 14:01:14 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:14 user devstack@n-api.service[61728]: method: > Apr 21 14:01:14 user devstack@n-api.service[61728]: exception: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:14 user devstack@n-api.service[61728]: action_args: {'id': '0346fbd8-64cd-45e7-906f-e00eeece91ce'} Apr 21 14:01:14 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:14 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Returning 404 to user: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c69b7098-f872-49c6-a1a4-fbb90aa47e14 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 404 len: 111 microversion: 2.1 time: 0.052504 Apr 21 14:01:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 60/181] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:14 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b942c6ad-7eca-48af-9c86-ffd081655567 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '.version_select at 0x7f160e2ab520>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b942c6ad-7eca-48af-9c86-ffd081655567 tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198905762" status: 202 len: 0 microversion: 2.1 time: 0.024587 Apr 21 14:01:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 14:01:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198905762 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:01:14 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "name": "network-vif-deleted", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:14 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] Creating event network-vif-deleted:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 14:01:14 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-31b8d6f3-0139-4f33-90ce-cc4172d96a04 req-5cd470e6-66e5-400a-8304-0f9640b4973d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029798 Apr 21 14:01:14 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 63/183] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] HTTP exception thrown: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Request method failure captured: Apr 21 14:01:15 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce HTTP/1.1 Apr 21 14:01:15 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:01:15 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:01:15 user devstack@n-api.service[61728]: Connection: close Apr 21 14:01:15 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:01:15 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:01:15 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:01:15 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:01:15 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZp64qM8y4VKmQ5YwcQuy2Uqo4BXR2iCKtiWpFZk5v5artGP9JkSGCt-QTfEDu9yv9P_WcG9q26zARz_KYMDrfcjwOVlO1KqS1mMt0qKupgF6OkxT2D4ftQO3ABkFtcZRlhIMhUhiU6r06tOXL_awbHyuWkO0N2pIGqN-rkrLONhR4 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Project-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1953479f081341b088eaecb8369fce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Tenant-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:15 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-User: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:15 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:01:15 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:01:15 user devstack@n-api.service[61728]: X-User-Id: 7ac1dc66f96249f884f9b4dbc73f37b4 Apr 21 14:01:15 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:15 user devstack@n-api.service[61728]: method: > Apr 21 14:01:15 user devstack@n-api.service[61728]: exception: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61728]: action_args: {'id': '0346fbd8-64cd-45e7-906f-e00eeece91ce'} Apr 21 14:01:15 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Returning 404 to user: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c7246f3b-99b4-4f14-84a8-ca2681d5e5ba tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 404 len: 111 microversion: 2.1 time: 0.030025 Apr 21 14:01:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:01:15 2023] DELETE /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] [instance: 0346fbd8-64cd-45e7-906f-e00eeece91ce] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] HTTP exception thrown: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Request method failure captured: Apr 21 14:01:15 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce HTTP/1.1 Apr 21 14:01:15 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:01:15 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:01:15 user devstack@n-api.service[61727]: Connection: close Apr 21 14:01:15 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:01:15 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:01:15 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:01:15 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:01:15 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZp64qM8y4VKmQ5YwcQuy2Uqo4BXR2iCKtiWpFZk5v5artGP9JkSGCt-QTfEDu9yv9P_WcG9q26zARz_KYMDrfcjwOVlO1KqS1mMt0qKupgF6OkxT2D4ftQO3ABkFtcZRlhIMhUhiU6r06tOXL_awbHyuWkO0N2pIGqN-rkrLONhR4 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Project-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1953479f081341b088eaecb8369fce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1953479f081341b088eaecb8369fce0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Tenant-Id: 1953479f081341b088eaecb8369fce0b Apr 21 14:01:15 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1130428952 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-User: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:15 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:01:15 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:01:15 user devstack@n-api.service[61727]: X-User-Id: 7ac1dc66f96249f884f9b4dbc73f37b4 Apr 21 14:01:15 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1130428952-project-member Apr 21 14:01:15 user devstack@n-api.service[61727]: method: > Apr 21 14:01:15 user devstack@n-api.service[61727]: exception: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61727]: action_args: {'id': '0346fbd8-64cd-45e7-906f-e00eeece91ce'} Apr 21 14:01:15 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. Apr 21 14:01:15 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] Returning 404 to user: Instance 0346fbd8-64cd-45e7-906f-e00eeece91ce could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d4dc6e45-232b-4a95-8731-09a68cfc79eb tempest-AttachSCSIVolumeTestJSON-1130428952 tempest-AttachSCSIVolumeTestJSON-1130428952-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce" status: 404 len: 111 microversion: 2.1 time: 0.035987 Apr 21 14:01:15 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:15 2023] GET /compute/v2.1/servers/0346fbd8-64cd-45e7-906f-e00eeece91ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae07df3-4bf4-44a5-a772-3507a6dde6ab", "name": "network-vif-plugged", "status": "completed", "tag": "15758bd1-cf67-4bc6-9408-9740cd79d26d"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] Creating event network-vif-plugged:15758bd1-cf67-4bc6-9408-9740cd79d26d for instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab on user Apr 21 14:01:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-9ca314ce-0ec6-4ec0-aef6-231e873a6390 req-b0a0f3f9-8d90-424c-9474-a8c2b4d85019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030926 Apr 21 14:01:15 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 64/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:17 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4d151d5d-7d21-42d8-8ad4-1f2d82217ea4 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa" status: 200 len: 1495 microversion: 2.1 time: 0.267977 Apr 21 14:01:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 62/187] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:17 2023] GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa => generated 1495 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e20a4f1a-a891-4c46-ba77-c684280ee887 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Action: 'create', calling method: .version_select at 0x7f160e197ac0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1562973392"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e20a4f1a-a891-4c46-ba77-c684280ee887 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.503460 Apr 21 14:01:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 21 14:01:23 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 505 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 21 14:01:23 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-75ac5606-4530-436a-b273-025ab3a7e56f tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Calling method '.version_select at 0x7f160e2f1f30>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:23 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-75ac5606-4530-436a-b273-025ab3a7e56f tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b" status: 200 len: 342 microversion: 2.1 time: 0.059220 Apr 21 14:01:23 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 65/189] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:23 2023] GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b => generated 342 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:24 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-99e86264-e0c1-40ac-bdb9-10d8933ce514 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Calling method '.version_select at 0x7f160e037e20>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-99e86264-e0c1-40ac-bdb9-10d8933ce514 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b" status: 200 len: 342 microversion: 2.1 time: 0.054823 Apr 21 14:01:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:24 2023] GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b => generated 342 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-749c5b81-c37b-4688-85d1-d503aaa765a1 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Calling method '.version_select at 0x7f160e0a00d0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-749c5b81-c37b-4688-85d1-d503aaa765a1 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b" status: 202 len: 0 microversion: 2.1 time: 0.105367 Apr 21 14:01:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:01:25 2023] DELETE /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:01:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8777be92-d888-4687-bf1e-0f6af699e4a9 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Calling method '.version_select at 0x7f160e09ac20>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:25 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-8777be92-d888-4687-bf1e-0f6af699e4a9 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] HTTP exception thrown: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. Apr 21 14:01:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8777be92-d888-4687-bf1e-0f6af699e4a9 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Request method failure captured: Apr 21 14:01:25 user devstack@n-api.service[61726]: request: GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b HTTP/1.1 Apr 21 14:01:25 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:01:25 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:01:25 user devstack@n-api.service[61726]: Connection: close Apr 21 14:01:25 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:01:25 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:01:25 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:01:25 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:01:25 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpczmFFHadUZL8LLRY1Fif5_38ZPbliQM6lKC2lUvxDbXNGnF-_c3dk6wSfUFkcgHgHs-pjdKhkP8cYNfXzzPyNpPaEY9LB31nw-aw_zytQeedm9hS_GV12TruwJ-Tl7sqk1y5iRe7mDRlZ6sKfGy-do15iHNibl4WMlLbssLQxld8M Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Project-Id: 6565370a48a64c029a93537b6b6e28cc Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1328440003 Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6565370a48a64c029a93537b6b6e28cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6565370a48a64c029a93537b6b6e28cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6565370a48a64c029a93537b6b6e28cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1328440003 Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Tenant-Id: 6565370a48a64c029a93537b6b6e28cc Apr 21 14:01:25 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1328440003 Apr 21 14:01:25 user devstack@n-api.service[61726]: X-User: tempest-VolumesSnapshotsTestJSON-1328440003-project-member Apr 21 14:01:25 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:01:25 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:01:25 user devstack@n-api.service[61726]: X-User-Id: 907d10cd8f604b62bad328442c8058c9 Apr 21 14:01:25 user devstack@n-api.service[61726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1328440003-project-member Apr 21 14:01:25 user devstack@n-api.service[61726]: method: Apr 21 14:01:25 user devstack@n-api.service[61726]: exception: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. Apr 21 14:01:25 user devstack@n-api.service[61726]: action_args: {'id': 'dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b'} Apr 21 14:01:25 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. (HTTP 404) (Request-ID: req-5888e7b1-5576-4fe5-8116-877e72ffb196) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. Apr 21 14:01:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:01:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8777be92-d888-4687-bf1e-0f6af699e4a9 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] Returning 404 to user: Volume dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:25 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-8777be92-d888-4687-bf1e-0f6af699e4a9 tempest-VolumesSnapshotsTestJSON-1328440003 tempest-VolumesSnapshotsTestJSON-1328440003-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b" status: 404 len: 109 microversion: 2.1 time: 0.036470 Apr 21 14:01:25 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:25 2023] GET /compute/v2.1/os-volumes/dfde68ed-8e57-4c40-8acb-2c0ab29d6c7b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-779fd302-8b6a-42fe-b070-504a9624af55 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Action: 'create', calling method: .version_select at 0x7f160e036c20>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2079298189", "metadata": {"Type": "work"}}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-779fd302-8b6a-42fe-b070-504a9624af55 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.432523 Apr 21 14:01:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 64/193] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 14:01:26 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 434 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 21 14:01:26 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:26 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-14588d05-8468-4575-adf4-6cb23c415a67 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Calling method '.version_select at 0x7f160e0a09d0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-14588d05-8468-4575-adf4-6cb23c415a67 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd" status: 200 len: 350 microversion: 2.1 time: 0.070379 Apr 21 14:01:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:26 2023] GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:28 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=26 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:28 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=36 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:28 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-7898ffc7-98f7-4f41-8a97-acada8b404ba tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Calling method '.version_select at 0x7f160e288f70>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:28 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-7898ffc7-98f7-4f41-8a97-acada8b404ba tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd" status: 200 len: 350 microversion: 2.1 time: 0.052917 Apr 21 14:01:28 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:28 2023] GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:28 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:28 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=5 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:01:28 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-8914f492-0479-4335-a649-e9064186683e tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Calling method '.version_select at 0x7f160e037eb0>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-8914f492-0479-4335-a649-e9064186683e tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd" status: 202 len: 0 microversion: 2.1 time: 0.113529 Apr 21 14:01:28 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:01:28 2023] DELETE /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:01:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-655e38ed-210d-4c3c-889e-84db2e8452d4 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Calling method '.version_select at 0x7f160e0a0700>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-655e38ed-210d-4c3c-889e-84db2e8452d4 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] HTTP exception thrown: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. Apr 21 14:01:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-655e38ed-210d-4c3c-889e-84db2e8452d4 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Request method failure captured: Apr 21 14:01:28 user devstack@n-api.service[61727]: request: GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd HTTP/1.1 Apr 21 14:01:28 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:01:28 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:01:28 user devstack@n-api.service[61727]: Connection: close Apr 21 14:01:28 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:01:28 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:01:28 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:01:28 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:01:28 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpc2WrwGIyRlHSJHmZXWiqhaTp-6fVsRy4h4csSp3On0rwHFIczBKqOAQbV-nDffmF01XQ6y_PFhcwZJy_7GMjAq-HC1g2SgLpTsbNryOx3Xo1c956FNJwQSaxECn1EPorZHrHR85O14MdOdnkczO9uaLfJ5EfEYMIqw68lMRnxI33c Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Project-Id: d942de60b1574c319dc0d872914effeb Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesGetTestJSON-1779663284 Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d942de60b1574c319dc0d872914effeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d942de60b1574c319dc0d872914effeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d942de60b1574c319dc0d872914effeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesGetTestJSON-1779663284 Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Tenant-Id: d942de60b1574c319dc0d872914effeb Apr 21 14:01:28 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesGetTestJSON-1779663284 Apr 21 14:01:28 user devstack@n-api.service[61727]: X-User: tempest-VolumesGetTestJSON-1779663284-project-member Apr 21 14:01:28 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:01:28 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:01:28 user devstack@n-api.service[61727]: X-User-Id: 33b7ba1b69514cb3b1fb576baaa181df Apr 21 14:01:28 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesGetTestJSON-1779663284-project-member Apr 21 14:01:28 user devstack@n-api.service[61727]: method: Apr 21 14:01:28 user devstack@n-api.service[61727]: exception: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. Apr 21 14:01:28 user devstack@n-api.service[61727]: action_args: {'id': '702094f1-4343-47fe-bce1-4b3eebeb5ffd'} Apr 21 14:01:28 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. (HTTP 404) (Request-ID: req-55e485f2-efe0-44d8-be72-19dc2c3511b4) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. Apr 21 14:01:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:01:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-655e38ed-210d-4c3c-889e-84db2e8452d4 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] Returning 404 to user: Volume 702094f1-4343-47fe-bce1-4b3eebeb5ffd could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-655e38ed-210d-4c3c-889e-84db2e8452d4 tempest-VolumesGetTestJSON-1779663284 tempest-VolumesGetTestJSON-1779663284-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd" status: 404 len: 109 microversion: 2.1 time: 0.040605 Apr 21 14:01:28 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:01:28 2023] GET /compute/v2.1/os-volumes/702094f1-4343-47fe-bce1-4b3eebeb5ffd => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:41 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a520db7e-fb4a-430c-b422-fa327cf5d91a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 200 len: 1538 microversion: 2.1 time: 0.238920 Apr 21 14:01:41 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:41 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 1538 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] [instance: 90591d9b-6d6b-4f22-a3dc-fd83044df26b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] HTTP exception thrown: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Request method failure captured: Apr 21 14:01:43 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b HTTP/1.1 Apr 21 14:01:43 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:01:43 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:01:43 user devstack@n-api.service[61728]: Connection: close Apr 21 14:01:43 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:01:43 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:01:43 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:01:43 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:01:43 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpajGeFURV7_2MQwFvmbGc33CR0dxcgqo-SO5NzEvdeaYs4XY94pzqdotfUHMKQ14RXUN3fM-erW4DFLBKD0EuZLnzWgCYsxLCsbfrJZ2Oo8BbwKyKI7e4hCnCdBhqPPpAlBHgIxddfBGwjchVNMglEgyarqumhhyCAjK2QUZ1kdOLo Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Project-Id: f4add6cbbd424513a25dacd5dfb3adcf Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Project-Name: tempest-DeleteServersTestJSON-356048122 Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4add6cbbd424513a25dacd5dfb3adcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4add6cbbd424513a25dacd5dfb3adcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4add6cbbd424513a25dacd5dfb3adcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Tenant: tempest-DeleteServersTestJSON-356048122 Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Tenant-Id: f4add6cbbd424513a25dacd5dfb3adcf Apr 21 14:01:43 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-DeleteServersTestJSON-356048122 Apr 21 14:01:43 user devstack@n-api.service[61728]: X-User: tempest-DeleteServersTestJSON-356048122-project-member Apr 21 14:01:43 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:01:43 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:01:43 user devstack@n-api.service[61728]: X-User-Id: f09a36fbec134e248aa2baec4bb6a53b Apr 21 14:01:43 user devstack@n-api.service[61728]: X-User-Name: tempest-DeleteServersTestJSON-356048122-project-member Apr 21 14:01:43 user devstack@n-api.service[61728]: method: > Apr 21 14:01:43 user devstack@n-api.service[61728]: exception: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. Apr 21 14:01:43 user devstack@n-api.service[61728]: action_args: {'id': '90591d9b-6d6b-4f22-a3dc-fd83044df26b'} Apr 21 14:01:43 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. Apr 21 14:01:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:01:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] Returning 404 to user: Instance 90591d9b-6d6b-4f22-a3dc-fd83044df26b could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:01:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e6fde0f4-15dc-47c1-ad9e-a3522c50a0c0 tempest-DeleteServersTestJSON-356048122 tempest-DeleteServersTestJSON-356048122-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b" status: 404 len: 111 microversion: 2.1 time: 0.031880 Apr 21 14:01:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:43 2023] GET /compute/v2.1/servers/90591d9b-6d6b-4f22-a3dc-fd83044df26b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:49 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:01:49 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4390cccd-f130-4fd0-a998-bfa1dd1e5a3b tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 204 len: 0 microversion: 2.1 time: 0.128931 Apr 21 14:01:49 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:01:49 2023] DELETE /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:49 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "name": "network-vif-unplugged", "status": "completed", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:49 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] Creating event network-vif-unplugged:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:01:49 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-941e7bee-2ca2-4e8a-8c75-61e1d17006d2 req-a1d733df-8b99-4926-86cb-1be3c11bbb94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036151 Apr 21 14:01:49 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 67/201] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:01:49 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-8ff44d1c-2fd9-48f1-b485-d992a98b3e4f tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 200 len: 1499 microversion: 2.1 time: 0.401086 Apr 21 14:01:49 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 69/202] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:01:49 2023] GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 1499 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:50 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:50 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-954d1d27-7d28-4c5a-bb6d-08a0329d9fa8 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 200 len: 1586 microversion: 2.20 time: 0.287045 Apr 21 14:01:50 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:01:50 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 1586 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:01:51 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "name": "network-vif-plugged", "status": "completed", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}, {"server_uuid": "4f8622ba-dea6-454f-90c8-1f5f6a56e0b4", "name": "network-vif-deleted", "tag": "9d4913bf-46f1-4c09-a062-803300bbed23"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Creating event network-vif-plugged:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:01:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] Creating event network-vif-deleted:9d4913bf-46f1-4c09-a062-803300bbed23 for instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 on user Apr 21 14:01:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-59aeaba1-7c23-4ab5-9e7b-714d0e6e6ed6 req-3747303a-82b4-415c-aa36-b148698bd431 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033184 Apr 21 14:01:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 68/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:52 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-424935120", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "4b38afb7-2b53-44fc-a4e0-7d79bef71734"}]}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:52 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] validate_networks() for [('4b38afb7-2b53-44fc-a4e0-7d79bef71734', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for user 132913991f8c45c1adaf5db7ef7cea30 and project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:01:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:01:53 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f00ab4ff-442e-4e8f-9a35-431c39aa8c1c tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.665455 Apr 21 14:01:53 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 70/205] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 14:01:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 14:01:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:01:53 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:01:53 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:53 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:53 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:01:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a07a5c14-1f00-44f7-b9a1-b52078c43efa tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6" status: 200 len: 1394 microversion: 2.87 time: 0.102029 Apr 21 14:01:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 68/206] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:01:53 2023] GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6 => generated 1394 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:01:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdceb24-27b8-45d3-93b2-6d68decc26b6", "tag": "4db14416-73b5-445f-9eef-7afad30c9cb7"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] Creating event network-changed:4db14416-73b5-445f-9eef-7afad30c9cb7 for instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 on user Apr 21 14:01:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f94cb0cb-8a71-4876-951c-9ada61be9901 req-09261d93-9b6e-44df-b5fe-633c784c7cc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Apr 21 14:01:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:01:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdceb24-27b8-45d3-93b2-6d68decc26b6", "name": "network-vif-deleted", "tag": "4db14416-73b5-445f-9eef-7afad30c9cb7"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:01:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:01:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:01:57 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:01:57 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.compute.server_external_events [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] Unable to find a host for instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6. Dropping event network-vif-deleted {{(pid=61726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 14:01:57 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-efa99579-e4f2-4781-99e7-aed43cfb0ea0 req-08f93a66-e8ee-4f8b-9ee7-98d8201a1a32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032737 Apr 21 14:01:57 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 71/208] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:02 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d1e7446af4edf8e35a9d0178b2895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4270d6dfa435f94da018d12586bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c39d6c72-4d33-4178-bcbf-75297166b2b5 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 200 len: 1673 microversion: 2.1 time: 0.251846 Apr 21 14:02:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:01 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ff55d2cb-b8f7-4374-a4d0-3bf17a3fc549 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '.version_select at 0x7f160e037130>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ff55d2cb-b8f7-4374-a4d0-3bf17a3fc549 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf" status: 204 len: 0 microversion: 2.1 time: 0.225185 Apr 21 14:02:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:03 2023] DELETE /compute/v2.1/images/90fd932f-31cf-449f-9483-baf7a6613bbf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:03 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] [instance: 2ae07df3-4bf4-44a5-a772-3507a6dde6ab] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] HTTP exception thrown: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Request method failure captured: Apr 21 14:02:03 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab HTTP/1.1 Apr 21 14:02:03 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:02:03 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:02:03 user devstack@n-api.service[61727]: Connection: close Apr 21 14:02:03 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:02:03 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:02:03 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:02:03 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:02:03 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpawVlE3DWdS15XLOF_CCPOtA15fbR2P7CmF57yPRtyv6xUTpgJ6KX3EyoPQBfd6Iev0VU8y4X2Ayu6fkUkH5TdmNpDG_-gCRsnOZabrW2smy0Ra9zbn8rHc_qNxDT9TBOtoMTHxMbts0Yq9ozuP8u2yUcGLqVWkSxGbUbq_yZGQlss Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Project-Id: 9daf036d4ad84586a628c454408e3d7d Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1600761065 Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9daf036d4ad84586a628c454408e3d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9daf036d4ad84586a628c454408e3d7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9daf036d4ad84586a628c454408e3d7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Tenant: tempest-SnapshotDataIntegrityTests-1600761065 Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Tenant-Id: 9daf036d4ad84586a628c454408e3d7d Apr 21 14:02:03 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1600761065 Apr 21 14:02:03 user devstack@n-api.service[61727]: X-User: tempest-SnapshotDataIntegrityTests-1600761065-project-member Apr 21 14:02:03 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:02:03 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:02:03 user devstack@n-api.service[61727]: X-User-Id: 1a2438d69a684df69e1de2edddc73bc0 Apr 21 14:02:03 user devstack@n-api.service[61727]: X-User-Name: tempest-SnapshotDataIntegrityTests-1600761065-project-member Apr 21 14:02:03 user devstack@n-api.service[61727]: method: > Apr 21 14:02:03 user devstack@n-api.service[61727]: exception: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. Apr 21 14:02:03 user devstack@n-api.service[61727]: action_args: {'id': '2ae07df3-4bf4-44a5-a772-3507a6dde6ab'} Apr 21 14:02:03 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. Apr 21 14:02:03 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:03 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Returning 404 to user: Instance 2ae07df3-4bf4-44a5-a772-3507a6dde6ab could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:02:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f4a7be2a-2db9-40b3-89d3-fb9cb1c6b953 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab" status: 404 len: 111 microversion: 2.1 time: 0.036343 Apr 21 14:02:03 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:03 2023] GET /compute/v2.1/servers/2ae07df3-4bf4-44a5-a772-3507a6dde6ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:02:03 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a4d80742-93df-4f9b-ae03-06c0011acf68 tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 204 len: 0 microversion: 2.1 time: 0.132942 Apr 21 14:02:03 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:02:03 2023] DELETE /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b2bb1d38-d87c-4732-bd55-2ff3c9733408 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] Calling method '.version_select at 0x7f160e0a2320>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b2bb1d38-d87c-4732-bd55-2ff3c9733408 tempest-SnapshotDataIntegrityTests-1600761065 tempest-SnapshotDataIntegrityTests-1600761065-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1470211823" status: 202 len: 0 microversion: 2.1 time: 0.028253 Apr 21 14:02:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 21 14:02:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1470211823 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:02:04 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d1e7446af4edf8e35a9d0178b2895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4c4270d6dfa435f94da018d12586bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:04 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b4a3c843-82a2-435f-ada0-6cde5dee76dd tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 200 len: 1679 microversion: 2.1 time: 0.423142 Apr 21 14:02:04 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:03 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 1679 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:02:05 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "name": "network-vif-unplugged", "status": "completed", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:05 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:05 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:05 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:05 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] Creating event network-vif-unplugged:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 14:02:05 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-07ae878e-068e-4153-b11a-f9ff6f75831b req-ba087b6a-341a-4cb6-aa33-8c6b033db86d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032046 Apr 21 14:02:05 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:05 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "name": "network-vif-deleted", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] Creating event network-vif-deleted:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 14:02:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-dd6c227f-6386-40c2-8295-f4902b0ac84b req-133f1cf9-feb1-4049-8ddc-3667b1d3da9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Apr 21 14:02:05 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:07 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5afe45-87ae-477a-8bf0-6a5e2036fb68", "name": "network-vif-plugged", "status": "completed", "tag": "2616f5a4-1b53-44bd-82ad-65419e2839ca"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:07 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] Creating event network-vif-plugged:2616f5a4-1b53-44bd-82ad-65419e2839ca for instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 on user Apr 21 14:02:07 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-eeeb2f78-87f5-4196-b1ae-0fe55425a313 req-2d64456e-8813-4a1d-82ab-70846db8fdda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028740 Apr 21 14:02:07 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:12 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-0869d46a-acc8-4a46-9f97-5aa527a85063 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] Action: 'create', calling method: .version_select at 0x7f160e28bac0>, body: {"keypair": {"name": "tempest-TestStampPattern-857246201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRQZJO4MljcVB3QymgO/OjeMKZf2ygAxSnuqjYP6Z4QlVBhAZ9Gng+v9fz8bPGxNgl8bpdLpSumnLdsXP0nI/YiROyL81E4N24aJpc1BKXV4xzBGPjOQn3DzdmzazHV7A=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:12 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:12 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-0869d46a-acc8-4a46-9f97-5aa527a85063 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] Getting quotas for project 457d232a64ab4bc4a849a9d08fcfad97. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:02:12 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-0869d46a-acc8-4a46-9f97-5aa527a85063 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] Getting quotas for user 3da34f003588407db874f23d25d3b3b1 and project 457d232a64ab4bc4a849a9d08fcfad97. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:02:12 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-0869d46a-acc8-4a46-9f97-5aa527a85063 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.334895 Apr 21 14:02:12 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 74/218] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:02:12 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f4d21104-a7d7-4c25-a310-eeb8727e6aa5 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] Calling method '.version_select at 0x7f160e0a3640>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f4d21104-a7d7-4c25-a310-eeb8727e6aa5 tempest-TestStampPattern-1337255177 tempest-TestStampPattern-1337255177-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-857246201" status: 202 len: 0 microversion: 2.1 time: 0.021282 Apr 21 14:02:15 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 14:02:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-857246201 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=12 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:19 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:02:19 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9994a6f9-f30b-499b-95f1-154db1e5ef36 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa" status: 204 len: 0 microversion: 2.1 time: 0.116067 Apr 21 14:02:19 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:02:19 2023] DELETE /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:19 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:19 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-c2a0184b-bd9e-4ab5-b624-de813df324d8 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa" status: 200 len: 1501 microversion: 2.1 time: 0.288449 Apr 21 14:02:19 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 75/221] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:19 2023] GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "name": "network-vif-unplugged", "status": "completed", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:19 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] Creating event network-vif-unplugged:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:02:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a9f3a002-5cec-4426-bf9c-81dab3542377 req-7bdf0993-5adc-402e-a1f4-c6661d8a03a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031138 Apr 21 14:02:19 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "name": "network-vif-deleted", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:20 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] Creating event network-vif-deleted:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:02:20 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-2b40144b-585f-4505-9c99-a494a08f1ff5 req-60c4c111-0cfa-49fa-b3ee-c30a00862de6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029564 Apr 21 14:02:20 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 74/223] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:21 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9164203a-8a6b-4078-bd98-c5ea7bc111fa", "name": "network-vif-plugged", "status": "completed", "tag": "70605424-311e-401f-b769-3e037210f46a"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:21 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:21 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:21 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] Creating event network-vif-plugged:70605424-311e-401f-b769-3e037210f46a for instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa on user Apr 21 14:02:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-df78cb93-bdcd-48be-b1c8-ca7f2e823ad8 req-af20bb93-ca20-4abc-8da7-e47e2db239b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Apr 21 14:02:22 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] HTTP exception thrown: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Request method failure captured: Apr 21 14:02:40 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 HTTP/1.1 Apr 21 14:02:40 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:02:40 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:02:40 user devstack@n-api.service[61727]: Connection: close Apr 21 14:02:40 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:02:40 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:02:40 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:02:40 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:02:40 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZrHhetEbJ-eR0NAhsQRkYqGC0-B8Hrf1Le-0OfWDXDhJl-4Budjrxrc0fMUZ5kEjcSeZCoy6xibDD-fdFY2icwIX0nlYakQjXzLSHqEoqsAI4ag6kutCryoyoDpIIbLzDuy6NPCN_hwBhmH6gI8LPYRI9bhW0yTYQWaGl2A_gK5kU Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Project-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Tenant: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Tenant-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:02:40 user devstack@n-api.service[61727]: X-User: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:02:40 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:02:40 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:02:40 user devstack@n-api.service[61727]: X-User-Id: 2259f365261c49b28b56ddd1c27c125d Apr 21 14:02:40 user devstack@n-api.service[61727]: X-User-Name: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:02:40 user devstack@n-api.service[61727]: method: > Apr 21 14:02:40 user devstack@n-api.service[61727]: exception: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:02:40 user devstack@n-api.service[61727]: action_args: {'id': '4f8622ba-dea6-454f-90c8-1f5f6a56e0b4'} Apr 21 14:02:40 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:02:40 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:02:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Returning 404 to user: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:02:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1a7ee43a-2250-403f-a4e6-3c80d1dde5f2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 404 len: 111 microversion: 2.1 time: 0.036373 Apr 21 14:02:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:40 2023] GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:40 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:40 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-470ea660-bc52-4265-be88-54f483cdc3d8 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1494 microversion: 2.1 time: 0.232812 Apr 21 14:02:40 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:40 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1494 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=8 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-61650fa1-b024-4567-b1c6-15d6faf03163 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.199987 Apr 21 14:02:41 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:02:41 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1/os-interface => generated 283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:42 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:42 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] Creating event network-changed:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:42 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-0619b44a-4c5d-4e18-bd83-7bcd8035ede2 req-f7e36672-f359-4a61-a0a2-2e7e33ced712 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030230 Apr 21 14:02:42 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 76/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c0cf8950-0a64-423c-b6b5-43261b7deb13 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1/ips" status: 200 len: 104 microversion: 2.1 time: 0.041387 Apr 21 14:02:42 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:02:42 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1/ips => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.objects.instance [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lazy-loading 'fault' on Instance uuid 3fdceb24-27b8-45d3-93b2-6d68decc26b6 {{(pid=61726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:43 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:43 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-108fde3a-a0fc-4d05-bc28-cc5c0a262354 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6" status: 200 len: 1649 microversion: 2.87 time: 0.117342 Apr 21 14:02:43 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 78/230] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:02:43 2023] GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6 => generated 1649 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Doing local delete in cell 9766f0b7-af82-4ef0-80ec-eb47f9a7deea(cell1) {{(pid=61727) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:43 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] instance's host None is down, deleting from database Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] deallocate_for_instance() {{(pid=61727) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Instance cache missing network info. {{(pid=61727) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Updating instance_info_cache with network_info: [] {{(pid=61727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 14:02:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61727) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 14:02:43 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 14:02:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-5580c0b1-6f61-42d7-ac7a-f75e070a5397 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6" status: 204 len: 0 microversion: 2.87 time: 0.533335 Apr 21 14:02:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 77/231] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:02:43 2023] DELETE /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 3fdceb24-27b8-45d3-93b2-6d68decc26b6] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] HTTP exception thrown: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Request method failure captured: Apr 21 14:02:44 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6 HTTP/1.1 Apr 21 14:02:44 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:02:44 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:02:44 user devstack@n-api.service[61728]: Connection: close Apr 21 14:02:44 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:02:44 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:02:44 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:02:44 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:02:44 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpad2XAJY_EVWPQTnxrvDioSABfj6II45t5vWSvPyBRiUDGQz75AWz6Hz6S9OL_zvbL0lcykuWwymdIceJzKJZEayJ6C2tZB_fnO8gLqvbNjjWJhwT7WYgnXs260NkX5cSFRwsUQYER4NF3tPjor4lyftN992gmubrZy4jb_cITA0qY Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Project-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Tenant-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-User: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:02:44 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:02:44 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:02:44 user devstack@n-api.service[61728]: X-User-Id: 132913991f8c45c1adaf5db7ef7cea30 Apr 21 14:02:44 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:02:44 user devstack@n-api.service[61728]: method: > Apr 21 14:02:44 user devstack@n-api.service[61728]: exception: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. Apr 21 14:02:44 user devstack@n-api.service[61728]: action_args: {'id': '3fdceb24-27b8-45d3-93b2-6d68decc26b6'} Apr 21 14:02:44 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. Apr 21 14:02:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Returning 404 to user: Instance 3fdceb24-27b8-45d3-93b2-6d68decc26b6 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:02:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d4bcd25b-ffc2-4e33-89df-e3e132dfd546 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6" status: 404 len: 111 microversion: 2.87 time: 0.070737 Apr 21 14:02:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 77/232] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:02:44 2023] GET /compute/v2.1/servers/3fdceb24-27b8-45d3-93b2-6d68decc26b6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-694783197", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "4b38afb7-2b53-44fc-a4e0-7d79bef71734"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:02:44 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] validate_networks() for [('4b38afb7-2b53-44fc-a4e0-7d79bef71734', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:02:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b32b176d-463a-4ddb-a1ff-04111ad59b3d tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 204 len: 0 microversion: 2.1 time: 0.110615 Apr 21 14:02:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:02:44 2023] DELETE /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113884844de14ec7ac8a20ba06a389b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f5972380fd48eabffd46e6727239ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5b57d95a-96e4-4cc4-a81a-5a99badb65e1 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 200 len: 1663 microversion: 2.1 time: 0.192706 Apr 21 14:02:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:44 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-unplugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] Creating event network-vif-unplugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-66cddcd2-c4b6-407b-ad13-939cf2fb3538 req-98e9b68d-8ff8-4c71-b778-305f58548656 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029628 Apr 21 14:02:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 80/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for user 132913991f8c45c1adaf5db7ef7cea30 and project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:02:45 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:02:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a87648c1-fe89-468f-bc4f-777050ea91a0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.144009 Apr 21 14:02:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 78/236] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 14:02:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 14:02:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:45 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:45 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:45 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:45 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-62a1e66c-d48a-4aec-8ac7-722b191f24fc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 200 len: 1394 microversion: 2.87 time: 0.104151 Apr 21 14:02:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 79/237] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:02:45 2023] GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 1394 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 14:02:46 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-deleted", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:46 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] Creating event network-vif-deleted:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-545c4e74-41c8-4ca0-a18f-ea57d8b8b0a8 req-acfe9563-ddea-478a-82d9-4f4f3d9d0585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Apr 21 14:02:46 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 81/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}, {"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}, {"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}, {"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-unplugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}, {"server_uuid": "ef0a7b15-eab4-4705-9f70-9c9117736eb1", "name": "network-vif-plugged", "status": "completed", "tag": "662f0568-767d-4dd9-b220-2936b4d96745"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Creating event network-vif-unplugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] Creating event network-vif-plugged:662f0568-767d-4dd9-b220-2936b4d96745 for instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 on user Apr 21 14:02:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-78317bd5-9d3d-496e-ac13-78d364ba4b8e req-01e27d57-3862-40cf-8820-7c416830b2e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032487 Apr 21 14:02:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] Creating event network-changed:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:02:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-be88b8ef-426d-48ff-a2f3-01ff1a3f69b5 req-e0a7df01-ea5b-4cda-9b5c-e73056bbca01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035763 Apr 21 14:02:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 80/240] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:50 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "name": "network-vif-plugged", "status": "completed", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:50 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:50 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:50 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:50 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] Creating event network-vif-plugged:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:02:50 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-7defd574-2058-4f7a-b455-3599e8670fa1 req-bb63a4d1-74d0-4c99-8a7d-c0bd5fc750ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027290 Apr 21 14:02:50 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:50 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-09ae75d9-601b-41d0-a4ca-16e5f7377165 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.177770 Apr 21 14:02:50 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 80/242] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 14:02:50 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66/os-interface => generated 282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 21 14:02:51 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] Creating event network-changed:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:02:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-b8244a85-b0a5-423c-8e85-af214268dc21 req-220d9f67-3fa8-4a6d-b2b0-fd5797a15b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027706 Apr 21 14:02:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 81/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:51 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-efd008ad-3c01-4a8b-960e-bcfc23d0c5d0 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66/ips" status: 200 len: 110 microversion: 2.20 time: 0.033340 Apr 21 14:02:51 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 14:02:51 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66/ips => generated 110 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 14:02:52 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "name": "network-vif-plugged", "status": "completed", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] Creating event network-vif-plugged:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:02:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-9a0a9ca4-f38a-4fd6-aea5-a82e5afbd378 req-1ef8ff85-d88c-4e06-a70e-a6411b79f785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031134 Apr 21 14:02:52 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:02:53 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-89eff8d1-5f21-40b2-b3cb-155290f11b75 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 204 len: 0 microversion: 2.20 time: 0.136682 Apr 21 14:02:53 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 82/246] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:02:52 2023] DELETE /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:53 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c19bad528a4c38860a43913b28b85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a8fedc10f324a92aef4142ab7efdd6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:02:53 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-63e77ad2-3a73-4cdb-b657-8009e8461aa7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 200 len: 1710 microversion: 2.20 time: 0.277900 Apr 21 14:02:53 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 84/247] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:02:53 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 1710 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "name": "network-vif-unplugged", "status": "completed", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}, {"server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "name": "network-vif-plugged", "status": "completed", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Creating event network-vif-unplugged:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:02:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] Creating event network-vif-plugged:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:02:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-48fb964f-4d58-4621-8566-5c7791b52cef req-7e7ca3da-6335-4452-a8c7-52cac351acb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032267 Apr 21 14:02:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] [instance: 2c5afe45-87ae-477a-8bf0-6a5e2036fb68] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] HTTP exception thrown: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Request method failure captured: Apr 21 14:02:54 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 HTTP/1.1 Apr 21 14:02:54 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:02:54 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:02:54 user devstack@n-api.service[61728]: Connection: close Apr 21 14:02:54 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:02:54 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:02:54 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:02:54 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:02:54 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZuQnjnYh31q4NZnTOTuiDqcqJGh4CI9zw3AAIbhd4vlVUryekLRmPuIwE2wOhISuk69E85jbAE-4sv2QIqpfMii9G9vkWeUUJF4m_oXHwKp8IdhAGVyT-oHA1T67ODPsD_iculMLKlSadbOl1uI49tpXVQslMLsbrr4ROFPenacGs Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Project-Id: b4c4270d6dfa435f94da018d12586bcd Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1083322898 Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4c4270d6dfa435f94da018d12586bcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4c4270d6dfa435f94da018d12586bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4c4270d6dfa435f94da018d12586bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerStableDeviceRescueTest-1083322898 Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Tenant-Id: b4c4270d6dfa435f94da018d12586bcd Apr 21 14:02:54 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1083322898 Apr 21 14:02:54 user devstack@n-api.service[61728]: X-User: tempest-ServerStableDeviceRescueTest-1083322898-project-member Apr 21 14:02:54 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:02:54 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:02:54 user devstack@n-api.service[61728]: X-User-Id: 0d7d1e7446af4edf8e35a9d0178b2895 Apr 21 14:02:54 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerStableDeviceRescueTest-1083322898-project-member Apr 21 14:02:54 user devstack@n-api.service[61728]: method: > Apr 21 14:02:54 user devstack@n-api.service[61728]: exception: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. Apr 21 14:02:54 user devstack@n-api.service[61728]: action_args: {'id': '2c5afe45-87ae-477a-8bf0-6a5e2036fb68'} Apr 21 14:02:54 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. Apr 21 14:02:54 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:02:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Returning 404 to user: Instance 2c5afe45-87ae-477a-8bf0-6a5e2036fb68 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:02:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-2b1b54f2-10e4-4b70-9a56-062110fd084a tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68" status: 404 len: 111 microversion: 2.1 time: 0.031204 Apr 21 14:02:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:02:54 2023] GET /compute/v2.1/servers/2c5afe45-87ae-477a-8bf0-6a5e2036fb68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:02:54 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5792a9d7-f3bb-4741-9375-ea8bda48d05d tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] Calling method '.version_select at 0x7f160e099bd0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:02:54 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5792a9d7-f3bb-4741-9375-ea8bda48d05d tempest-ServerStableDeviceRescueTest-1083322898 tempest-ServerStableDeviceRescueTest-1083322898-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535115748" status: 202 len: 0 microversion: 2.1 time: 0.030899 Apr 21 14:02:54 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:02:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535115748 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ecc039-866c-4a11-969f-cb59bd0a4f66", "name": "network-vif-deleted", "tag": "94f4ff5c-4646-4e4d-814a-40e8e72ad32e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:02:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:02:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] Creating event network-vif-deleted:94f4ff5c-4646-4e4d-814a-40e8e72ad32e for instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 on user Apr 21 14:02:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-cf7c6fac-c895-4038-9fa8-c9c05245ec6d req-9a20255b-069b-4059-81f6-7167262ac2e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050684 Apr 21 14:02:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:02:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:03:06 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:06 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:06 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:06 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1976108837", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] validate_networks() for [('6942adb6-1e24-4361-9a43-e8b692767b1f', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Getting quotas for project 432a123307454a44922597d6c9089447. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Getting quotas for user 4df58f0cb48f4aa29df57f9c2f632782 and project 432a123307454a44922597d6c9089447. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:03:07 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:03:07 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-652cf0df-de15-414f-a288-3d8bd171d651 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.902179 Apr 21 14:03:07 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 84/252] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:03:06 2023] POST /compute/v2.1/servers => generated 381 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:03:07 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5284310c-e529-4711-ab55-4ef478b71bcd tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:07 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-5284310c-e529-4711-ab55-4ef478b71bcd tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:07 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-5284310c-e529-4711-ab55-4ef478b71bcd tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:07 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5284310c-e529-4711-ab55-4ef478b71bcd tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014" status: 200 len: 1216 microversion: 2.1 time: 0.137850 Apr 21 14:03:07 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:07 2023] GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:07 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:07 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-718848885", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] validate_networks() for [('6942adb6-1e24-4361-9a43-e8b692767b1f', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Getting quotas for project 432a123307454a44922597d6c9089447. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Getting quotas for user 4df58f0cb48f4aa29df57f9c2f632782 and project 432a123307454a44922597d6c9089447. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:03:08 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:03:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-84d27e58-e667-4d64-a887-8d04a68185e4 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.799622 Apr 21 14:03:08 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 84/254] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:03:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:03:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7f960791-41fe-42f7-8961-d0c7ba4a640a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:08 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7f960791-41fe-42f7-8961-d0c7ba4a640a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:08 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-7f960791-41fe-42f7-8961-d0c7ba4a640a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7f960791-41fe-42f7-8961-d0c7ba4a640a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 200 len: 1215 microversion: 2.1 time: 0.063408 Apr 21 14:03:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:08 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: 9164203a-8a6b-4078-bd98-c5ea7bc111fa] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:09 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] HTTP exception thrown: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Request method failure captured: Apr 21 14:03:09 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa HTTP/1.1 Apr 21 14:03:09 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:03:09 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:03:09 user devstack@n-api.service[61726]: Connection: close Apr 21 14:03:09 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:03:09 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:03:09 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:03:09 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:03:09 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZoOQDET3-GDDNqie2zDfLq8FMq7QxhnGcnlL91pFWGUtInrvv29oXBcbS-HKoxJPYsCD-RHG4DHwSNKDhOBANgwQp5lC3NUkuMynGL1S6eljIYbbzTZQWlcjH9Cp4imYauAG6EEzxm_Yj2KcIjAwObVU_FBBeTakpa1_eB474rlYU Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Project-Id: 15f83d6d2c3049e9ba1ac7f04ad2ebb0 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Project-Name: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Tenant: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Tenant-Id: 15f83d6d2c3049e9ba1ac7f04ad2ebb0 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-User: tempest-VolumesAdminNegativeTest-1182596808-project-member Apr 21 14:03:09 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:03:09 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:03:09 user devstack@n-api.service[61726]: X-User-Id: b60caf53ee58417cb76a77c963a45ec2 Apr 21 14:03:09 user devstack@n-api.service[61726]: X-User-Name: tempest-VolumesAdminNegativeTest-1182596808-project-member Apr 21 14:03:09 user devstack@n-api.service[61726]: method: > Apr 21 14:03:09 user devstack@n-api.service[61726]: exception: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. Apr 21 14:03:09 user devstack@n-api.service[61726]: action_args: {'id': '9164203a-8a6b-4078-bd98-c5ea7bc111fa'} Apr 21 14:03:09 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. Apr 21 14:03:09 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:09 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Returning 404 to user: Instance 9164203a-8a6b-4078-bd98-c5ea7bc111fa could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:09 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5802146e-df8b-4f1a-ba8b-f8a5b218e19c tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa" status: 404 len: 111 microversion: 2.1 time: 0.029726 Apr 21 14:03:09 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:09 2023] GET /compute/v2.1/servers/9164203a-8a6b-4078-bd98-c5ea7bc111fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:10 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:03:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-771584ca-2050-4d18-9421-540be7661a0f tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27" status: 204 len: 0 microversion: 2.1 time: 0.164892 Apr 21 14:03:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:03:09 2023] DELETE /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:10 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:10 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] Creating event network-changed:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:03:10 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-e4643efe-447e-49bc-b87d-25028193d3a3 req-659ccdd0-e5ae-4a56-a061-95fd84085bb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033238 Apr 21 14:03:10 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 88/258] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:03:10 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60caf53ee58417cb76a77c963a45ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f83d6d2c3049e9ba1ac7f04ad2ebb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f25e06c3-10b3-40d1-9768-ca056744af97 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27" status: 200 len: 1669 microversion: 2.1 time: 0.401462 Apr 21 14:03:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 86/259] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:10 2023] GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 => generated 1669 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-unplugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] Creating event network-vif-unplugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7ce8b59a-274b-4ec6-ae84-f640cd8fe06c req-6a063e22-4eec-40de-a662-ff295407d5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038864 Apr 21 14:03:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 86/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:03:11 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:11 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] Creating event network-changed:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:03:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-3c577b1c-3488-4271-9b47-2f1bfb0c7f9b req-8043eec9-6af1-4314-9ed7-e712c53c2353 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152163 Apr 21 14:03:11 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 89/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:03:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}, {"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}, {"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}, {"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-unplugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}, {"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-plugged", "status": "completed", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}, {"server_uuid": "f0f32b68-6993-4843-bcc6-bd0e06377b27", "name": "network-vif-deleted", "tag": "20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-unplugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-plugged:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] Creating event network-vif-deleted:20ca5a57-3cd5-47ad-bdfe-f56a0ecd078b for instance f0f32b68-6993-4843-bcc6-bd0e06377b27 on user Apr 21 14:03:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-a120e27a-0b4f-4444-a959-6b3dedcb4fb2 req-baa59771-28f0-43a2-af3d-e09ba46a69c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.043249 Apr 21 14:03:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 87/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "name": "network-vif-plugged", "status": "completed", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}, {"server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "name": "network-vif-plugged", "status": "completed", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Creating event network-vif-plugged:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:03:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] Creating event network-vif-plugged:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:03:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-38985e9f-32d2-46eb-9bc8-765f78d75d7c req-8ab2dd94-db77-4c37-81bc-52bcbcb05853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034580 Apr 21 14:03:13 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 87/263] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:03:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}, {"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:03:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:03:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-8a30ed1f-a078-4abb-adf2-231154cd0154 req-4d757970-aa4b-4cd2-94a3-93fe1547478c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030634 Apr 21 14:03:15 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 90/264] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:03:34 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 HTTP/1.1 Apr 21 14:03:34 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:03:34 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:03:34 user devstack@n-api.service[61728]: Connection: close Apr 21 14:03:34 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:03:34 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:03:34 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:03:34 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:03:34 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:34 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:34 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:34 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:03:34 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:03:34 user devstack@n-api.service[61728]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:03:34 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:34 user devstack@n-api.service[61728]: method: > Apr 21 14:03:34 user devstack@n-api.service[61728]: exception: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:34 user devstack@n-api.service[61728]: action_args: {'id': 'ef0a7b15-eab4-4705-9f70-9c9117736eb1'} Apr 21 14:03:34 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-528a817f-7586-4438-ba42-374783e30451 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 404 len: 111 microversion: 2.1 time: 0.139684 Apr 21 14:03:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:34 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-055e83f1-a43c-4f40-8370-64b46bc1f4f0 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '.version_select at 0x7f160df3bb50>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-055e83f1-a43c-4f40-8370-64b46bc1f4f0 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493985608" status: 202 len: 0 microversion: 2.1 time: 0.030988 Apr 21 14:03:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 88/266] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:03:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493985608 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=12 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=8 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:03:35 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 HTTP/1.1 Apr 21 14:03:35 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:03:35 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:03:35 user devstack@n-api.service[61728]: Connection: close Apr 21 14:03:35 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:03:35 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:03:35 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:03:35 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:03:35 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61728]: method: > Apr 21 14:03:35 user devstack@n-api.service[61728]: exception: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: action_args: {'id': 'ef0a7b15-eab4-4705-9f70-9c9117736eb1'} Apr 21 14:03:35 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-967c61d2-cdd9-4e09-bf97-8b7d2f06ce3a tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 404 len: 111 microversion: 2.1 time: 0.029764 Apr 21 14:03:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 89/267] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:03:35 2023] DELETE /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: ef0a7b15-eab4-4705-9f70-9c9117736eb1] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:03:35 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 HTTP/1.1 Apr 21 14:03:35 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:03:35 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:03:35 user devstack@n-api.service[61727]: Connection: close Apr 21 14:03:35 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:03:35 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:03:35 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:03:35 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:03:35 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61727]: method: > Apr 21 14:03:35 user devstack@n-api.service[61727]: exception: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: action_args: {'id': 'ef0a7b15-eab4-4705-9f70-9c9117736eb1'} Apr 21 14:03:35 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance ef0a7b15-eab4-4705-9f70-9c9117736eb1 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4f1568ec-a649-46e2-b445-b42ecc619e07 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1" status: 404 len: 111 microversion: 2.1 time: 0.032025 Apr 21 14:03:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 89/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:35 2023] GET /compute/v2.1/servers/ef0a7b15-eab4-4705-9f70-9c9117736eb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:03:35 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 HTTP/1.1 Apr 21 14:03:35 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:03:35 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:03:35 user devstack@n-api.service[61728]: Connection: close Apr 21 14:03:35 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:03:35 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:03:35 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:03:35 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:03:35 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:03:35 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61728]: method: > Apr 21 14:03:35 user devstack@n-api.service[61728]: exception: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: action_args: {'id': '5030decd-cbe5-4495-b497-dfacf25eef73'} Apr 21 14:03:35 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-01d029b3-13f6-4124-a934-daf54a58867b tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 404 len: 111 microversion: 2.1 time: 0.027805 Apr 21 14:03:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:03:35 2023] DELETE /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] [instance: 5030decd-cbe5-4495-b497-dfacf25eef73] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:35 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:35 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-3f14e445-281f-4e69-865f-0cd03b3e77ba tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 200 len: 1689 microversion: 2.87 time: 0.303257 Apr 21 14:03:35 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 91/270] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:03:35 2023] GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:03:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] HTTP exception thrown: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Request method failure captured: Apr 21 14:03:35 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 HTTP/1.1 Apr 21 14:03:35 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:03:35 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:03:35 user devstack@n-api.service[61727]: Connection: close Apr 21 14:03:35 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:03:35 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:03:35 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:03:35 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:03:35 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZf8lPKsoMciB82k5zQPAg2p8A1KKQ3_deEQ3yQs4SjbR5mzUchKrGjZ0ylWjaVR0UqreuIVMlSIiw3CbgtXJIqG6ve2AK9bVr0H21pRrlc2BZUccpbG8aZs-7ypnKi3Ifw4bfT2e81YJN3rslk2vt35fijTsm-28lfYDREo0OD0qE Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91f5972380fd48eabffd46e6727239ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant-Id: 91f5972380fd48eabffd46e6727239ce Apr 21 14:03:35 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194238008 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Id: 113884844de14ec7ac8a20ba06a389b3 Apr 21 14:03:35 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeTestJSON-1194238008-project-member Apr 21 14:03:35 user devstack@n-api.service[61727]: method: > Apr 21 14:03:35 user devstack@n-api.service[61727]: exception: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: action_args: {'id': '5030decd-cbe5-4495-b497-dfacf25eef73'} Apr 21 14:03:35 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. Apr 21 14:03:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] Returning 404 to user: Instance 5030decd-cbe5-4495-b497-dfacf25eef73 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c839243e-4688-4e52-a236-3cb25153b558 tempest-AttachVolumeTestJSON-1194238008 tempest-AttachVolumeTestJSON-1194238008-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73" status: 404 len: 111 microversion: 2.1 time: 0.027542 Apr 21 14:03:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 90/271] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:35 2023] GET /compute/v2.1/servers/5030decd-cbe5-4495-b497-dfacf25eef73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:42 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3c5bc67c-c894-47d1-95a7-4fcb45932d4c tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1494 microversion: 2.1 time: 0.243783 Apr 21 14:03:42 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 91/272] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:41 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1494 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:43 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:03:43 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 HTTP/1.1 Apr 21 14:03:43 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:03:43 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:03:43 user devstack@n-api.service[61726]: Connection: close Apr 21 14:03:43 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:03:43 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:03:43 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:03:43 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:03:43 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:43 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:43 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:43 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:03:43 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:03:43 user devstack@n-api.service[61726]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:03:43 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:43 user devstack@n-api.service[61726]: method: > Apr 21 14:03:43 user devstack@n-api.service[61726]: exception: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:43 user devstack@n-api.service[61726]: action_args: {'id': '96ecc039-866c-4a11-969f-cb59bd0a4f66'} Apr 21 14:03:43 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:43 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:43 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-de5670af-e88e-4ca5-b8ba-c94a8954e314 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 404 len: 111 microversion: 2.20 time: 0.246801 Apr 21 14:03:43 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 92/273] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:03:43 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:03:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-63abb46d-cd23-40fc-a99a-cb42513bddc7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '.version_select at 0x7f160df3bd90>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-63abb46d-cd23-40fc-a99a-cb42513bddc7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-33325504" status: 204 len: 0 microversion: 2.20 time: 0.022299 Apr 21 14:03:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 91/274] 10.0.0.210 () {64 vars in 1333 bytes} [Fri Apr 21 14:03:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-33325504 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:03:44 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 HTTP/1.1 Apr 21 14:03:44 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:03:44 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:03:44 user devstack@n-api.service[61728]: Connection: close Apr 21 14:03:44 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:03:44 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:03:44 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:03:44 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:03:44 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61728]: method: > Apr 21 14:03:44 user devstack@n-api.service[61728]: exception: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: action_args: {'id': '96ecc039-866c-4a11-969f-cb59bd0a4f66'} Apr 21 14:03:44 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4cae72ce-426e-4823-898b-e07a1f34a8d2 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 404 len: 111 microversion: 2.20 time: 0.026654 Apr 21 14:03:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:03:44 2023] DELETE /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 96ecc039-866c-4a11-969f-cb59bd0a4f66] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:03:44 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 HTTP/1.1 Apr 21 14:03:44 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:03:44 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:03:44 user devstack@n-api.service[61726]: Connection: close Apr 21 14:03:44 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:03:44 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:03:44 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:03:44 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:03:44 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61726]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:03:44 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61726]: method: > Apr 21 14:03:44 user devstack@n-api.service[61726]: exception: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61726]: action_args: {'id': '96ecc039-866c-4a11-969f-cb59bd0a4f66'} Apr 21 14:03:44 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. Apr 21 14:03:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 96ecc039-866c-4a11-969f-cb59bd0a4f66 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-bdf1ad2e-706d-46ee-b37d-1e6125b220b7 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66" status: 404 len: 111 microversion: 2.20 time: 0.030270 Apr 21 14:03:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:03:44 2023] GET /compute/v2.1/servers/96ecc039-866c-4a11-969f-cb59bd0a4f66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:03:44 user devstack@n-api.service[61727]: request: DELETE /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c HTTP/1.1 Apr 21 14:03:44 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:03:44 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:03:44 user devstack@n-api.service[61727]: Connection: close Apr 21 14:03:44 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:03:44 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:03:44 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:03:44 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:03:44 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61727]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:03:44 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61727]: method: > Apr 21 14:03:44 user devstack@n-api.service[61727]: exception: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61727]: action_args: {'id': '3af27bc9-9617-44c7-bfa4-993b347d183c'} Apr 21 14:03:44 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f974e3fe-eb7e-48be-9bf1-09dfa7f23fe6 tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 404 len: 111 microversion: 2.20 time: 0.032067 Apr 21 14:03:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 92/277] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:03:44 2023] DELETE /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] [instance: 3af27bc9-9617-44c7-bfa4-993b347d183c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] HTTP exception thrown: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Request method failure captured: Apr 21 14:03:44 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c HTTP/1.1 Apr 21 14:03:44 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:03:44 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:03:44 user devstack@n-api.service[61728]: Connection: close Apr 21 14:03:44 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:03:44 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:03:44 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:03:44 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:03:44 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZtCWHk3dZjTfR-oOwkaX2f97G3YzCRDiPyRsDG7-vTSrks8zkAuWA1QHG275H4TfAVWRHQ1YUZQpf2yWnSCo3qHPqJLCrFImANYpN3oeLHPJ9YGjl5jyrELGlrG3CEH-Yoc4y_EOOQszYLeW-G2SjV1BazbcS4oocVtw0anI1fTSk Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a8fedc10f324a92aef4142ab7efdd6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant-Id: 8a8fedc10f324a92aef4142ab7efdd6a Apr 21 14:03:44 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2115713901 Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Id: 92c19bad528a4c38860a43913b28b85b Apr 21 14:03:44 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2115713901-project-member Apr 21 14:03:44 user devstack@n-api.service[61728]: method: > Apr 21 14:03:44 user devstack@n-api.service[61728]: exception: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: action_args: {'id': '3af27bc9-9617-44c7-bfa4-993b347d183c'} Apr 21 14:03:44 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. Apr 21 14:03:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:03:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] Returning 404 to user: Instance 3af27bc9-9617-44c7-bfa4-993b347d183c could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:03:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e0565453-ae2b-4665-bdaf-fa407429a45d tempest-AttachVolumeShelveTestJSON-2115713901 tempest-AttachVolumeShelveTestJSON-2115713901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c" status: 404 len: 111 microversion: 2.20 time: 0.034371 Apr 21 14:03:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:03:44 2023] GET /compute/v2.1/servers/3af27bc9-9617-44c7-bfa4-993b347d183c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:03:55 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=8 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:55 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=10 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:56 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-db105b11-0532-4bf3-959b-1f9843e7b037 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: .version_select at 0x7f160e2f1ab0>, body: {"keypair": {"name": "tempest-keypair-500746232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlxdy5PoliBeRnt4tWYC7Fu7pkGOage/HG8uxLBIgt7DEFt1QHK8dwArdP14y447xyPamNSB8z6pOZhh9qz3WsCy+knrmjpHD2UmoJzo5C/B6YDf9z6px5GYzSzQaO+nA=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:56 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-db105b11-0532-4bf3-959b-1f9843e7b037 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:03:56 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-db105b11-0532-4bf3-959b-1f9843e7b037 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:03:56 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-db105b11-0532-4bf3-959b-1f9843e7b037 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161184 Apr 21 14:03:56 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:03:55 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:03:57 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2067580371", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "31b07b9f-0a0f-426a-97d6-12b23e611818"}], "security_groups": [{"name": "tempest-securitygroup--112067443"}], "key_name": "tempest-keypair-500746232", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:03:57 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:57 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:57 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] validate_networks() for [('31b07b9f-0a0f-426a-97d6-12b23e611818', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:03:58 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:03:58 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-be5b22e5-55c3-482e-965b-a7738789623b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.667268 Apr 21 14:03:58 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 93/280] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:03:57 2023] POST /compute/v2.1/servers => generated 399 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:03:58 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-96734870-88d1-43e8-ac21-2b24cb42781c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:58 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-96734870-88d1-43e8-ac21-2b24cb42781c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:58 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=12 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:58 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:03:58 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-96734870-88d1-43e8-ac21-2b24cb42781c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-96734870-88d1-43e8-ac21-2b24cb42781c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 200 len: 1235 microversion: 2.1 time: 0.078623 Apr 21 14:03:58 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:58 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 1235 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:03:58 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:03:59 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:03:59 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4f037aa2-6ce3-4d21-90fd-cd54ac62a03d tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 200 len: 1503 microversion: 2.1 time: 0.220942 Apr 21 14:03:59 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:03:58 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:04:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] Creating event network-changed:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:04:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-9746c4ef-86e7-4b1b-a0d5-3a1f5487f3e4 req-7a1021f7-e05b-4306-acc5-6794166ccf12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Apr 21 14:04:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 95/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] [instance: f0f32b68-6993-4843-bcc6-bd0e06377b27] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] HTTP exception thrown: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Request method failure captured: Apr 21 14:04:00 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 HTTP/1.1 Apr 21 14:04:00 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:04:00 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:04:00 user devstack@n-api.service[61727]: Connection: close Apr 21 14:04:00 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:04:00 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:04:00 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:04:00 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:04:00 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZoOQDET3-GDDNqie2zDfLq8FMq7QxhnGcnlL91pFWGUtInrvv29oXBcbS-HKoxJPYsCD-RHG4DHwSNKDhOBANgwQp5lC3NUkuMynGL1S6eljIYbbzTZQWlcjH9Cp4imYauAG6EEzxm_Yj2KcIjAwObVU_FBBeTakpa1_eB474rlYU Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Project-Id: 15f83d6d2c3049e9ba1ac7f04ad2ebb0 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15f83d6d2c3049e9ba1ac7f04ad2ebb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Tenant-Id: 15f83d6d2c3049e9ba1ac7f04ad2ebb0 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1182596808 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-User: tempest-VolumesAdminNegativeTest-1182596808-project-member Apr 21 14:04:00 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:04:00 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:04:00 user devstack@n-api.service[61727]: X-User-Id: b60caf53ee58417cb76a77c963a45ec2 Apr 21 14:04:00 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesAdminNegativeTest-1182596808-project-member Apr 21 14:04:00 user devstack@n-api.service[61727]: method: > Apr 21 14:04:00 user devstack@n-api.service[61727]: exception: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. Apr 21 14:04:00 user devstack@n-api.service[61727]: action_args: {'id': 'f0f32b68-6993-4843-bcc6-bd0e06377b27'} Apr 21 14:04:00 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. Apr 21 14:04:00 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:04:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Returning 404 to user: Instance f0f32b68-6993-4843-bcc6-bd0e06377b27 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:04:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-dd37cb35-1169-44c7-aac5-342e12351002 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27" status: 404 len: 111 microversion: 2.1 time: 0.221131 Apr 21 14:04:00 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:00 2023] GET /compute/v2.1/servers/f0f32b68-6993-4843-bcc6-bd0e06377b27 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:04:00 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-311b96e3-265b-4fe3-bbb9-79dbf7e8c981 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] Calling method '.version_select at 0x7f160e09b520>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:00 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-311b96e3-265b-4fe3-bbb9-79dbf7e8c981 tempest-VolumesAdminNegativeTest-1182596808 tempest-VolumesAdminNegativeTest-1182596808-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507777159" status: 202 len: 0 microversion: 2.1 time: 0.020074 Apr 21 14:04:00 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:04:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507777159 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:04:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "name": "network-vif-plugged", "status": "completed", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] Creating event network-vif-plugged:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:04:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-57dc499d-a9a1-4c2c-8181-d9397c04b83d req-6fc2c606-655c-48f8-af1d-deae31032293 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273359 Apr 21 14:04:02 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 96/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "name": "network-vif-plugged", "status": "completed", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] Creating event network-vif-plugged:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:04:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-5abbc397-51b0-49cc-a796-fb8e9b3f3bb5 req-be51dae0-827f-4070-901a-aeac2887882d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029846 Apr 21 14:04:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 95/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-df44ceb9-72f2-4f9c-9929-899fee075e35 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Action: 'create', calling method: .version_select at 0x7f160df4da20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-414912251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBy5F7/eY34kH4kknTNvubOiNWmdv324rEiVr8ZZ6u/8wGu10U4U/vV+TgZkfkWQO0m1rbrGO251QOQqyVSfRO8QzK8Jq0lU+/cWevf7A1waDImolju4hBpvNELhkWYjog=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-df44ceb9-72f2-4f9c-9929-899fee075e35 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:04:32 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-df44ceb9-72f2-4f9c-9929-899fee075e35 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for user 9d40cdc3312b43d286d8a79cde9f5418 and project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:04:32 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-df44ceb9-72f2-4f9c-9929-899fee075e35 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053959 Apr 21 14:04:32 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 97/288] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:04:32 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:32 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:32 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-478405333", "imageRef": "a08ba1b8-74ec-4c3c-9d31-0cd58b006bb0", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-414912251", "networks": [{"uuid": "12b23d1e-f3a6-4c34-989d-1c89ee946e24"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:32 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] validate_networks() for [('12b23d1e-f3a6-4c34-989d-1c89ee946e24', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for user 9d40cdc3312b43d286d8a79cde9f5418 and project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:04:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a08ba1b8-74ec-4c3c-9d31-0cd58b006bb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:04:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-abd604e0-0326-4fc3-96ca-83b7773da2f3 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.673677 Apr 21 14:04:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:04:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9450c155-6a85-4386-9c18-942de63e604f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-9450c155-6a85-4386-9c18-942de63e604f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:34 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-9450c155-6a85-4386-9c18-942de63e604f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9450c155-6a85-4386-9c18-942de63e604f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 200 len: 1251 microversion: 2.1 time: 0.091688 Apr 21 14:04:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 96/290] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:34 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 1251 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1811984779"}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:37 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f1cfe12d-45a5-47b1-8688-6dae102a1305 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5/action" status: 202 len: 52 microversion: 2.87 time: 1.305519 Apr 21 14:04:37 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 98/291] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 14:04:35 2023] POST /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5/action => generated 52 bytes in 1307 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 21 14:04:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] Creating event network-changed:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:04:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-4c0d29fb-99d8-46e6-987a-83ed2f08602e req-a8955481-b1fd-410d-9d6a-0230ed31448f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Apr 21 14:04:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "name": "network-vif-plugged", "status": "completed", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] Creating event network-vif-plugged:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:04:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-38f25cad-d8ab-4b8d-b8ea-c02aaec81908 req-c25f45fe-a990-42b6-86a9-c06e793343f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035547 Apr 21 14:04:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 97/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:42 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:42 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-044b976f-ca9d-481f-a3ca-40b12a25475e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1494 microversion: 2.1 time: 0.272964 Apr 21 14:04:42 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:42 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1494 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:04:42 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "name": "network-vif-plugged", "status": "completed", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:42 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] Creating event network-vif-plugged:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:04:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-caabe8f0-cd3d-4ed6-8824-c71ace2c6c4a req-988ff5c3-354e-41cd-8c7a-385bd1331283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027782 Apr 21 14:04:42 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 99/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:43 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d30cfdc8-744d-47b1-a448-f113ff9f624e tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 200 len: 1689 microversion: 2.87 time: 0.268697 Apr 21 14:04:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 98/296] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:04:43 2023] GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:04:45 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-e69897a2-99d1-423d-8acb-3509187a5ef3 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Action: 'create', calling method: .version_select at 0x7f160e1acf70>, body: {"keypair": {"name": "tempest-keypair-2085847639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtS2vU2hjTdBp9+5GXmMtOFB68EC/JBp4srwATzJ0qLZ+BQocGkSEAP1z1S9M9P1kEv0Vd6quAa1O8JdG4KfvkaPJsmlaSpX/6CyeVnURB0GwGeWV66UBeLbeyknARPA=="}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:46 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-e69897a2-99d1-423d-8acb-3509187a5ef3 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Getting quotas for project 41c39fcb224f4e69a73734be43ba6588. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:04:46 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-e69897a2-99d1-423d-8acb-3509187a5ef3 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Getting quotas for user 95f0f10528294c9bb3d4f58f3361c358 and project 41c39fcb224f4e69a73734be43ba6588. Resources: {'key_pairs'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:04:46 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-e69897a2-99d1-423d-8acb-3509187a5ef3 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210254 Apr 21 14:04:46 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 100/297] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:04:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-564594493", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d9138a89-3d80-4ef8-b937-1613f614c9e8"}], "security_groups": [{"name": "tempest-securitygroup--576829017"}], "key_name": "tempest-keypair-2085847639", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:47 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] validate_networks() for [('d9138a89-3d80-4ef8-b937-1613f614c9e8', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Getting quotas for project 41c39fcb224f4e69a73734be43ba6588. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Getting quotas for user 95f0f10528294c9bb3d4f58f3361c358 and project 41c39fcb224f4e69a73734be43ba6588. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:04:48 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:04:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9d29eff9-da55-47c0-932c-3e451f642049 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639696 Apr 21 14:04:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 100/298] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:04:47 2023] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:04:48 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:48 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d9ed1a2e-64fa-42da-aca5-9556f930ffb0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:48 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d9ed1a2e-64fa-42da-aca5-9556f930ffb0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:48 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d9ed1a2e-64fa-42da-aca5-9556f930ffb0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:48 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d9ed1a2e-64fa-42da-aca5-9556f930ffb0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1232 microversion: 2.1 time: 0.067257 Apr 21 14:04:48 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:48 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1232 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:04:48 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:48 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-3fa929b4-c294-4f4b-b399-6159e33bad8b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 200 len: 1544 microversion: 2.1 time: 0.239974 Apr 21 14:04:48 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:48 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:04:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] Creating event network-changed:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:04:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-d27eba96-d321-41dd-848f-4c108fdbce82 req-f4ff79e9-15bd-4d27-9442-9aa829fa89d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031116 Apr 21 14:04:50 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 101/301] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:52 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "name": "network-vif-plugged", "status": "completed", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] Creating event network-vif-plugged:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:04:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-45345ea1-cb06-435c-8f7e-49c0560e14da req-af16ce61-fabb-4827-8925-fc8899feb0af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057038 Apr 21 14:04:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 100/302] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:55 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "name": "network-vif-plugged", "status": "completed", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:55 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:55 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:55 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:55 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] Creating event network-vif-plugged:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:04:55 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-d3f097c2-2216-4dae-baef-054628994fdf req-f37cf140-1803-4b13-87ac-a5d0a39624e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058316 Apr 21 14:04:55 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 102/303] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:04:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:59 user devstack@n-api.service[61728]: DEBUG nova.objects.instance [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lazy-loading 'flavor' on Instance uuid 80eb182f-948b-42d3-999b-339c5d615a73 {{(pid=61728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 14:04:59 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5248437d-164f-4a51-9f0c-fdb8e9c2a7b7 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "POST /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73/action" status: 200 len: 32 microversion: 2.1 time: 0.151578 Apr 21 14:04:59 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 102/304] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 14:04:59 2023] POST /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:04:59 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:04:59 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-0980202d-5a51-4ac5-a621-06330e443c1e tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 200 len: 1509 microversion: 2.1 time: 0.257997 Apr 21 14:04:59 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:04:59 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:00 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:00 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-unplugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:00 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:00 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:00 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:00 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] Creating event network-vif-unplugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:05:00 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-23382440-a121-4ec8-9e86-41d622b31ec8 req-07e72f7b-fb35-4c83-bdce-b94f3ac96517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050886 Apr 21 14:05:00 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 103/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:05:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-2cddcfe4-dfca-47da-bd9e-d4550c2371dc req-b873639f-5c3d-45b2-9bb6-9d466ac3ba7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036466 Apr 21 14:05:02 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}, {"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=19 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:04 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=17 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:05:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:05:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-11db2380-857a-4eab-887d-b70a4140cde5 req-4b2b91bb-bedd-4fbd-8090-1a9455a9f565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043417 Apr 21 14:05:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 102/308] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:24 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:24 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-642b8f21-7938-40bd-8f26-6d419ad7fe2d tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 200 len: 1536 microversion: 2.1 time: 0.265007 Apr 21 14:05:24 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:05:24 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 1536 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:38 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:38 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6ade4989-745b-4e43-b33a-91c44577b302 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1539 microversion: 2.1 time: 0.230489 Apr 21 14:05:38 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:05:38 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1205999674", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "2edfef44-2867-4e03-a53e-b139f99afa75", "destination_type": "volume"}], "networks": [{"uuid": "4b38afb7-2b53-44fc-a4e0-7d79bef71734"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:43 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:43 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] validate_networks() for [('4b38afb7-2b53-44fc-a4e0-7d79bef71734', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:05:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:43 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:44 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-fb102833-788a-4e6e-aeb0-9adb959c6908 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1494 microversion: 2.1 time: 0.226168 Apr 21 14:05:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:05:43 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Getting quotas for user 132913991f8c45c1adaf5db7ef7cea30 and project 885cdc1521a14985bfa70ae21e73c693. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:05:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:05:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-6d5776b1-8d73-4ca5-b971-6a445d7be8bf tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.584083 Apr 21 14:05:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 103/312] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 14:05:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 14:05:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:44 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:44 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:44 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c33c8dc0-32a8-4dd9-9340-cae9289f31dc tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71" status: 200 len: 1395 microversion: 2.87 time: 0.072328 Apr 21 14:05:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 105/313] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:05:44 2023] GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71 => generated 1395 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:05:46 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4878d9-5766-433a-9f81-4bb92c369e71", "tag": "a6133e22-45a6-4a63-8885-91a7b439d45b"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:46 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:46 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] Creating event network-changed:a6133e22-45a6-4a63-8885-91a7b439d45b for instance 4e4878d9-5766-433a-9f81-4bb92c369e71 on user Apr 21 14:05:46 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-8c82eaee-cba8-48dd-8508-1d413e78a937 req-0dc0a38a-8277-48c5-b261-493c0f9345cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028760 Apr 21 14:05:46 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 106/314] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:48 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:48 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-95dc7870-6ccf-4278-94de-50c07fb2eb1a tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.156419 Apr 21 14:05:48 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:05:48 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:49 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:49 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:05:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:49 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:49 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] Creating event network-changed:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:05:49 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7cd6b8b2-a9df-4ebc-9d46-3b988c3d640f req-9da32b3e-8d5a-4ffe-9ad9-176bcb88efd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030579 Apr 21 14:05:49 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 106/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-ffe98d16-b3e5-4803-9379-fcc6d24f5f52 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd/ips" status: 200 len: 108 microversion: 2.1 time: 0.035089 Apr 21 14:05:49 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 107/317] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:05:49 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:49 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:49 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-bf4c01e6-d6a5-4439-96d6-8aaeb20534d9 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 200 len: 1489 microversion: 2.1 time: 0.374336 Apr 21 14:05:49 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 105/318] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:05:49 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 1489 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:50 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:05:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-cad82dd2-f9d4-4b57-954c-34583b4b67c5 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 204 len: 0 microversion: 2.1 time: 0.115682 Apr 21 14:05:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:05:50 2023] DELETE /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:51 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:05:51 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-9f8e15cb-46e3-401c-8efd-82c68e16f3d8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 200 len: 1669 microversion: 2.1 time: 0.254423 Apr 21 14:05:51 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:05:51 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:05:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "name": "network-vif-unplugged", "status": "completed", "tag": "451630a7-eec6-4614-8737-498026e8d671"}, {"server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "name": "network-vif-plugged", "status": "completed", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Creating event network-vif-unplugged:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:05:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] Creating event network-vif-plugged:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:05:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-dd88e5d9-0f83-4fa3-929a-c6cf1425dba8 req-de9bffd0-3dee-457f-ac80-516320179c65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028405 Apr 21 14:05:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 106/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:51 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:05:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4878d9-5766-433a-9f81-4bb92c369e71", "name": "network-vif-deleted", "tag": "a6133e22-45a6-4a63-8885-91a7b439d45b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.compute.server_external_events [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] Unable to find a host for instance 4e4878d9-5766-433a-9f81-4bb92c369e71. Dropping event network-vif-deleted {{(pid=61728) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 14:05:52 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-535b73c1-677e-4d6f-a8fd-35f5f5f283e4 req-d6d5c9f3-558b-4061-981c-a9ed2d84a449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026912 Apr 21 14:05:52 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 108/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 14:05:52 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac5a363-5528-4d5f-8c90-6f9ad69a06dd", "name": "network-vif-deleted", "tag": "451630a7-eec6-4614-8737-498026e8d671"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:05:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:05:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:05:52 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:05:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] Creating event network-vif-deleted:451630a7-eec6-4614-8737-498026e8d671 for instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd on user Apr 21 14:05:52 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-1df6f219-d538-4fb1-a45e-97ff76a62524 req-41e964b1-2e8b-4d51-b1e9-d5e71c545c13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085596 Apr 21 14:05:52 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 109/323] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:25 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4136ce6d-8d6e-471d-a98c-c1f9b4102c52 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 200 len: 1536 microversion: 2.1 time: 0.243413 Apr 21 14:06:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:24 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 1536 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Searching by: {'deleted': False, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982'} {{(pid=61728) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:25 user devstack@n-api.service[61728]: DEBUG nova.compute.multi_cell_list [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61728) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 14:06:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-55a1edb0-4ba0-4d0d-b426-9f03f01260b0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.212723 Apr 21 14:06:25 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 14:06:25 2023] GET /compute/v2.1/servers => generated 340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=10 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=20 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:25 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:25 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-900f1d2c-7e1e-44e1-96aa-15fd7167eaa0 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 200 len: 1536 microversion: 2.1 time: 0.207129 Apr 21 14:06:25 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:25 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 1536 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:26 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:06:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-993420df-7193-4cf6-ae38-9b0897b85317 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 204 len: 0 microversion: 2.1 time: 0.107970 Apr 21 14:06:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:06:26 2023] DELETE /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:27 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3e4c5eb8-74e1-49bc-9661-fc6bbabacb20 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 200 len: 1542 microversion: 2.1 time: 0.158626 Apr 21 14:06:27 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:27 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 1542 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:27 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "name": "network-vif-unplugged", "status": "completed", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:27 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] Creating event network-vif-unplugged:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:06:27 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-be057b73-bddd-42a2-823e-91c6cdd1d52a req-bdc113ac-3028-42df-9445-f6f4f4e3ec2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030305 Apr 21 14:06:27 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "name": "network-vif-deleted", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] Creating event network-vif-deleted:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:06:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-1b1940fc-4385-4eb7-a20d-b8cc7cbd0d08 req-4706eb9c-d3ec-4e2b-ad42-ed0dc643d1bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Apr 21 14:06:28 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:29 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf0c20f-ffda-4578-adae-9aaef4c4bd18", "name": "network-vif-plugged", "status": "completed", "tag": "c4696818-c28f-4798-a5c4-1a4b64a5a79f"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:29 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] Creating event network-vif-plugged:c4696818-c28f-4798-a5c4-1a4b64a5a79f for instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 on user Apr 21 14:06:29 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-79077539-734e-4203-9fee-3b940073fb93 req-b44b1fb7-50a9-4c85-ab27-45774729aaed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031234 Apr 21 14:06:29 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.objects.instance [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lazy-loading 'fault' on Instance uuid 4e4878d9-5766-433a-9f81-4bb92c369e71 {{(pid=61726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:34 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:34 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a906e357-ae78-498d-91bc-67b449e69dde tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71" status: 200 len: 1650 microversion: 2.87 time: 0.109688 Apr 21 14:06:34 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 112/332] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:06:34 2023] GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71 => generated 1650 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Doing local delete in cell 9766f0b7-af82-4ef0-80ec-eb47f9a7deea(cell1) {{(pid=61727) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:34 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] instance's host None is down, deleting from database Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] deallocate_for_instance() {{(pid=61727) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Instance cache missing network info. {{(pid=61727) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Updating instance_info_cache with network_info: [] {{(pid=61727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 14:06:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61727) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 14:06:34 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 14:06:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-618ea0a7-0b8d-4309-8b79-ad6aa9c99456 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71" status: 204 len: 0 microversion: 2.87 time: 0.301198 Apr 21 14:06:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 110/333] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:06:34 2023] DELETE /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4e4878d9-5766-433a-9f81-4bb92c369e71] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] HTTP exception thrown: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Request method failure captured: Apr 21 14:06:35 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71 HTTP/1.1 Apr 21 14:06:35 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:06:35 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:06:35 user devstack@n-api.service[61728]: Connection: close Apr 21 14:06:35 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:06:35 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:06:35 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:06:35 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:06:35 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpad2XAJY_EVWPQTnxrvDioSABfj6II45t5vWSvPyBRiUDGQz75AWz6Hz6S9OL_zvbL0lcykuWwymdIceJzKJZEayJ6C2tZB_fnO8gLqvbNjjWJhwT7WYgnXs260NkX5cSFRwsUQYER4NF3tPjor4lyftN992gmubrZy4jb_cITA0qY Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Project-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Tenant-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-User: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:06:35 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:06:35 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:06:35 user devstack@n-api.service[61728]: X-User-Id: 132913991f8c45c1adaf5db7ef7cea30 Apr 21 14:06:35 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:06:35 user devstack@n-api.service[61728]: method: > Apr 21 14:06:35 user devstack@n-api.service[61728]: exception: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. Apr 21 14:06:35 user devstack@n-api.service[61728]: action_args: {'id': '4e4878d9-5766-433a-9f81-4bb92c369e71'} Apr 21 14:06:35 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. Apr 21 14:06:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Returning 404 to user: Instance 4e4878d9-5766-433a-9f81-4bb92c369e71 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:06:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b85cca93-511b-4f7d-ae86-182db02a981f tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71" status: 404 len: 111 microversion: 2.87 time: 0.028244 Apr 21 14:06:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 112/334] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:06:35 2023] GET /compute/v2.1/servers/4e4878d9-5766-433a-9f81-4bb92c369e71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:06:35 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-db2506a5-0957-44fb-92b9-d4c1690dee5b tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 204 len: 0 microversion: 2.87 time: 0.130783 Apr 21 14:06:35 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 113/335] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:06:35 2023] DELETE /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:35 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b39b2760-eaf0-4cba-b481-e59d9500b26a tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 200 len: 1695 microversion: 2.87 time: 0.257425 Apr 21 14:06:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 111/336] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:06:35 2023] GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 1695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "name": "network-vif-unplugged", "status": "completed", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] Creating event network-vif-unplugged:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:06:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f54bd141-6559-483f-ad24-abd48de581f2 req-ecd0fc60-31fe-418f-8786-d1d3539b4008 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028459 Apr 21 14:06:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 113/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:36 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "name": "network-vif-deleted", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] Creating event network-vif-deleted:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:06:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-a3a550eb-2e63-433d-8a7e-10ab123506c9 req-efd30182-1efa-455a-b228-b430f881e0fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048332 Apr 21 14:06:36 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 114/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44d9f3-28b2-45e7-b952-2bb1735ef5b5", "name": "network-vif-plugged", "status": "completed", "tag": "5c5a52bd-c710-4614-8353-55be240cfa17"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] Creating event network-vif-plugged:5c5a52bd-c710-4614-8353-55be240cfa17 for instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 on user Apr 21 14:06:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-9d486a63-09ff-4817-9838-64aed935deb3 req-58881d9b-36cc-4ea6-9bba-d129c62d22ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028816 Apr 21 14:06:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:39 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ab65a594-d6fd-4809-b30e-3f4482402371 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.527125 Apr 21 14:06:39 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:06:38 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff/os-interface => generated 283 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:40 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:40 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:40 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:40 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:40 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] Creating event network-changed:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:06:40 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-97b5648a-a8ec-4b6d-9f98-9771ac6642ae req-3f31b161-6a27-47c8-ac35-fe259e98cbde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031253 Apr 21 14:06:40 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 115/341] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:40 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8f85317d-f050-481b-af39-2973df664fed tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1539 microversion: 2.1 time: 0.260075 Apr 21 14:06:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 113/342] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:40 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:40 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:40 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-22f3ca1d-107e-42cc-9c8c-27e8046699cf tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1539 microversion: 2.1 time: 0.315200 Apr 21 14:06:40 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:40 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:06:41 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd HTTP/1.1 Apr 21 14:06:41 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:06:41 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:06:41 user devstack@n-api.service[61726]: Connection: close Apr 21 14:06:41 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:06:41 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:06:41 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:06:41 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:06:41 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:06:41 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:06:41 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:06:41 user devstack@n-api.service[61726]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:06:41 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:06:41 user devstack@n-api.service[61726]: method: > Apr 21 14:06:41 user devstack@n-api.service[61726]: exception: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:06:41 user devstack@n-api.service[61726]: action_args: {'id': 'aac5a363-5528-4d5f-8c90-6f9ad69a06dd'} Apr 21 14:06:41 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:06:41 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:06:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-45ace30f-2ef5-4e08-b3a1-3f49b645b2e9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 404 len: 111 microversion: 2.1 time: 0.028344 Apr 21 14:06:41 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:41 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:06:41 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-bcb14973-5552-4aed-b269-3a4da8000e1f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '.version_select at 0x7f160df3bd90>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:41 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-bcb14973-5552-4aed-b269-3a4da8000e1f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500746232" status: 202 len: 0 microversion: 2.1 time: 0.020009 Apr 21 14:06:41 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 114/345] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 14:06:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500746232 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:06:42 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3e82e646-254a-44c8-a34c-644b3330d11b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: .version_select at 0x7f160e095b40>, body: {"keypair": {"name": "tempest-keypair-571092211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVTbSwwxECYrofWLzM3xM2athtWkhHO4PmnRUvV4IeHkFrsz3GVwS5pKQyGAUvFsHgrVRcBmNgHjdWVkJa8/B3vkVSYjn5BwhRB1DM72Kz9Nxe+lrLjXM+s4ubHvbbIIg=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:42 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-3e82e646-254a-44c8-a34c-644b3330d11b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:06:42 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-3e82e646-254a-44c8-a34c-644b3330d11b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:06:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3e82e646-254a-44c8-a34c-644b3330d11b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045368 Apr 21 14:06:42 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 116/346] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:06:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:06:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1414365371", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "31b07b9f-0a0f-426a-97d6-12b23e611818"}], "security_groups": [{"name": "tempest-securitygroup--659464002"}], "key_name": "tempest-keypair-571092211", "user_data": "}} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:43 user devstack@n-api.service[61726]: DEBUG nova.network.neutron [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] validate_networks() for [('31b07b9f-0a0f-426a-97d6-12b23e611818', None, None, None, None, None)] {{(pid=61726) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image limits 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image pref 0:0:0 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.virt.hardware [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.quota [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Going to run 1 instances... {{(pid=61726) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:06:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-c25a10af-9723-4d60-bc2c-1722c38efc3b tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.651031 Apr 21 14:06:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 117/347] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:06:43 2023] POST /compute/v2.1/servers => generated 399 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5bcfb091-7f1c-4c32-85b8-e0305d7d64e7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5bcfb091-7f1c-4c32-85b8-e0305d7d64e7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-5bcfb091-7f1c-4c32-85b8-e0305d7d64e7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-5bcfb091-7f1c-4c32-85b8-e0305d7d64e7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 200 len: 1235 microversion: 2.1 time: 0.085448 Apr 21 14:06:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 115/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:44 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] HTTP exception thrown: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Request method failure captured: Apr 21 14:06:44 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 HTTP/1.1 Apr 21 14:06:44 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:06:44 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:06:44 user devstack@n-api.service[61728]: Connection: close Apr 21 14:06:44 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:06:44 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:06:44 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:06:44 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:06:44 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpZrHhetEbJ-eR0NAhsQRkYqGC0-B8Hrf1Le-0OfWDXDhJl-4Budjrxrc0fMUZ5kEjcSeZCoy6xibDD-fdFY2icwIX0nlYakQjXzLSHqEoqsAI4ag6kutCryoyoDpIIbLzDuy6NPCN_hwBhmH6gI8LPYRI9bhW0yTYQWaGl2A_gK5kU Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Project-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Tenant: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Tenant-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61728]: X-User: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:06:44 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:06:44 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:06:44 user devstack@n-api.service[61728]: X-User-Id: 2259f365261c49b28b56ddd1c27c125d Apr 21 14:06:44 user devstack@n-api.service[61728]: X-User-Name: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:06:44 user devstack@n-api.service[61728]: method: > Apr 21 14:06:44 user devstack@n-api.service[61728]: exception: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61728]: action_args: {'id': '4f8622ba-dea6-454f-90c8-1f5f6a56e0b4'} Apr 21 14:06:44 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Returning 404 to user: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:06:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7abe9c9c-dfda-4dd6-89c1-fa5431cdb2ce tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 404 len: 111 microversion: 2.1 time: 0.031240 Apr 21 14:06:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:06:44 2023] DELETE /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] HTTP exception thrown: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Request method failure captured: Apr 21 14:06:44 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 HTTP/1.1 Apr 21 14:06:44 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:06:44 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:06:44 user devstack@n-api.service[61726]: Connection: close Apr 21 14:06:44 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:06:44 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:06:44 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:06:44 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:06:44 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpZrHhetEbJ-eR0NAhsQRkYqGC0-B8Hrf1Le-0OfWDXDhJl-4Budjrxrc0fMUZ5kEjcSeZCoy6xibDD-fdFY2icwIX0nlYakQjXzLSHqEoqsAI4ag6kutCryoyoDpIIbLzDuy6NPCN_hwBhmH6gI8LPYRI9bhW0yTYQWaGl2A_gK5kU Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Project-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Project-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Tenant: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Tenant-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:06:44 user devstack@n-api.service[61726]: X-User: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:06:44 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:06:44 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:06:44 user devstack@n-api.service[61726]: X-User-Id: 2259f365261c49b28b56ddd1c27c125d Apr 21 14:06:44 user devstack@n-api.service[61726]: X-User-Name: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:06:44 user devstack@n-api.service[61726]: method: > Apr 21 14:06:44 user devstack@n-api.service[61726]: exception: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61726]: action_args: {'id': '4f8622ba-dea6-454f-90c8-1f5f6a56e0b4'} Apr 21 14:06:44 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. Apr 21 14:06:44 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:06:44 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Returning 404 to user: Instance 4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:06:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-8e5b2659-5960-4a40-8820-705a72e8355e tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4" status: 404 len: 111 microversion: 2.1 time: 0.031590 Apr 21 14:06:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:44 2023] GET /compute/v2.1/servers/4f8622ba-dea6-454f-90c8-1f5f6a56e0b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:06:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=20,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:06:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-13e7cd54-9120-4d9b-93c9-dc1ce9c82cd3 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 204 len: 0 microversion: 2.1 time: 0.125880 Apr 21 14:06:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:06:44 2023] DELETE /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:45 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2259f365261c49b28b56ddd1c27c125d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c210480b33473c91156b798bcbd8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3b984c99-f8bf-4336-8bde-c7c95c83742a tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 200 len: 1500 microversion: 2.1 time: 0.328375 Apr 21 14:06:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:44 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 1500 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:06:45 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "name": "network-vif-unplugged", "status": "completed", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:45 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:45 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:45 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:45 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] Creating event network-vif-unplugged:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 14:06:45 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-5ea70900-6392-4291-a0ee-798dd71cd002 req-7245b471-93f4-4d2e-b650-60a98ca3c4e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028380 Apr 21 14:06:45 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 119/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "name": "network-vif-deleted", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] Creating event network-vif-deleted:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 14:06:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-384a5a86-af78-4b7a-a6bc-bf1584069bf0 req-3353a2c2-83fe-4872-b3b3-806691a99e5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Apr 21 14:06:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 117/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30068c4a-94ed-4b84-9178-0d554326fc68", "name": "network-vif-plugged", "status": "completed", "tag": "7361228d-9a8e-4921-9cb8-fc59a0a45063"}, {"name": "network-changed", "server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Creating event network-vif-plugged:7361228d-9a8e-4921-9cb8-fc59a0a45063 for instance 30068c4a-94ed-4b84-9178-0d554326fc68 on user Apr 21 14:06:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] Creating event network-changed:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:06:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f2105737-e576-491a-9f1f-eb11b64decb0 req-90e89e04-70d4-4b63-b9dd-50a71d35d670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.031329 Apr 21 14:06:47 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:49 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}, {"server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:06:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:49 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Creating event network-vif-plugged:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:06:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] Creating event network-vif-plugged:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:06:49 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-5f07eef1-4b2e-4154-bcb6-4e42dfaf97ad req-98dfd0a4-d1a0-41f8-ae51-0260c3709b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030151 Apr 21 14:06:49 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 120/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:06:50 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:06:50 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-01528332-fc83-49e4-9aeb-838dd2c5414a tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014" status: 200 len: 1505 microversion: 2.1 time: 0.217542 Apr 21 14:06:50 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 118/357] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:06:50 2023] GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=40 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: 5cf0c20f-ffda-4578-adae-9aaef4c4bd18] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] HTTP exception thrown: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Request method failure captured: Apr 21 14:07:17 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 HTTP/1.1 Apr 21 14:07:17 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:07:17 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:07:17 user devstack@n-api.service[61728]: Connection: close Apr 21 14:07:17 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:07:17 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:07:17 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:07:17 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:07:17 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpfmOoBcxbYlVsJcc9b1Ee7MB1lR3OZjunFYeMxJQnu3GKc8H8-llB0Zez0Qga0vpmoZMOA0wL_hbZqaMf7kTxyF2lKT9DDby5n0X1baBwIJ2xxVI2LwCN0OEUf3_FOY0tu2OdiJQr0-EqLkWVek6VCZLg8IZGyz9Joukt4giu2IV8k Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Project-Id: cfa1f4e6f7864477b911420ea2ecb982 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Project-Name: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Tenant: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Tenant-Id: cfa1f4e6f7864477b911420ea2ecb982 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-User: tempest-TestMinimumBasicScenario-515927679-project-member Apr 21 14:07:17 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:07:17 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:07:17 user devstack@n-api.service[61728]: X-User-Id: 9d40cdc3312b43d286d8a79cde9f5418 Apr 21 14:07:17 user devstack@n-api.service[61728]: X-User-Name: tempest-TestMinimumBasicScenario-515927679-project-member Apr 21 14:07:17 user devstack@n-api.service[61728]: method: > Apr 21 14:07:17 user devstack@n-api.service[61728]: exception: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. Apr 21 14:07:17 user devstack@n-api.service[61728]: action_args: {'id': '5cf0c20f-ffda-4578-adae-9aaef4c4bd18'} Apr 21 14:07:17 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. Apr 21 14:07:17 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:07:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Returning 404 to user: Instance 5cf0c20f-ffda-4578-adae-9aaef4c4bd18 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:07:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ecef171d-6bb8-417a-8ae4-de197eb99ffa tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18" status: 404 len: 111 microversion: 2.1 time: 0.037323 Apr 21 14:07:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:17 2023] GET /compute/v2.1/servers/5cf0c20f-ffda-4578-adae-9aaef4c4bd18 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:07:17 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:17 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b79ce4ba-4501-4e25-9712-45dfba4be45c tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '.version_select at 0x7f160e099fc0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:17 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b79ce4ba-4501-4e25-9712-45dfba4be45c tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414912251" status: 202 len: 0 microversion: 2.1 time: 0.031371 Apr 21 14:07:17 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 121/359] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 21 14:07:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414912251 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-ba296cf8-ea27-480b-9aef-99ce49e6ac1b tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Action: 'create', calling method: .version_select at 0x7f160df3acb0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-788075712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO55/5HhCQZkcFVfgVGrulI3atlpFKQjKnI78/kM4uimAx0bJQlbEfcxM2XQeW2c86vQX6nUo1+E0FJJHQNMap4lIvFfRYGCEovcOc6baFnAovI9vNKGBK33RQ9htMU1w=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-ba296cf8-ea27-480b-9aef-99ce49e6ac1b tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:07:19 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-ba296cf8-ea27-480b-9aef-99ce49e6ac1b tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for user 9d40cdc3312b43d286d8a79cde9f5418 and project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:07:19 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-ba296cf8-ea27-480b-9aef-99ce49e6ac1b tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055320 Apr 21 14:07:19 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 119/360] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:07:19 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:19 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2134957043", "imageRef": "6d7eb54a-b068-4162-bd98-5a21649fbd2b", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-788075712", "networks": [{"uuid": "12b23d1e-f3a6-4c34-989d-1c89ee946e24"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:19 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] validate_networks() for [('12b23d1e-f3a6-4c34-989d-1c89ee946e24', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Getting quotas for user 9d40cdc3312b43d286d8a79cde9f5418 and project cfa1f4e6f7864477b911420ea2ecb982. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:07:20 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6d7eb54a-b068-4162-bd98-5a21649fbd2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:07:20 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7cc7c8df-0004-42e7-bf4d-a9ffceb51414 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.574161 Apr 21 14:07:20 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:07:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:07:20 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-d6fdf557-0105-4d20-98c6-bf54b7c66461 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:20 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-d6fdf557-0105-4d20-98c6-bf54b7c66461 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:20 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-d6fdf557-0105-4d20-98c6-bf54b7c66461 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:20 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-d6fdf557-0105-4d20-98c6-bf54b7c66461 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 200 len: 1252 microversion: 2.1 time: 0.062665 Apr 21 14:07:20 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 122/362] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:20 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 1252 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] Creating event network-changed:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:07:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-298ee2a8-368c-4b1d-980e-f0fe92c86044 req-c2e8906e-2f34-46a1-b37a-f859515ef5b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026992 Apr 21 14:07:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 120/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:25 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "name": "network-vif-plugged", "status": "completed", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] Creating event network-vif-plugged:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:07:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-856b725b-50f0-4bc0-8830-dbaad75f5ee7 req-fe33f6ec-147a-4a59-b9f6-ec21dfe2e42e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036076 Apr 21 14:07:25 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:25 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] HTTP exception thrown: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Request method failure captured: Apr 21 14:07:25 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 HTTP/1.1 Apr 21 14:07:25 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:07:25 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:07:25 user devstack@n-api.service[61726]: Connection: close Apr 21 14:07:25 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:07:25 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:07:25 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:07:25 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:07:25 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpad2XAJY_EVWPQTnxrvDioSABfj6II45t5vWSvPyBRiUDGQz75AWz6Hz6S9OL_zvbL0lcykuWwymdIceJzKJZEayJ6C2tZB_fnO8gLqvbNjjWJhwT7WYgnXs260NkX5cSFRwsUQYER4NF3tPjor4lyftN992gmubrZy4jb_cITA0qY Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Project-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Tenant-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-User: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:07:25 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:07:25 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:07:25 user devstack@n-api.service[61726]: X-User-Id: 132913991f8c45c1adaf5db7ef7cea30 Apr 21 14:07:25 user devstack@n-api.service[61726]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:07:25 user devstack@n-api.service[61726]: method: > Apr 21 14:07:25 user devstack@n-api.service[61726]: exception: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. Apr 21 14:07:25 user devstack@n-api.service[61726]: action_args: {'id': '4a44d9f3-28b2-45e7-b952-2bb1735ef5b5'} Apr 21 14:07:25 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. Apr 21 14:07:25 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:07:25 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Returning 404 to user: Instance 4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:07:25 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-da696681-dbb7-4c7d-8e33-d077544118d0 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5" status: 404 len: 111 microversion: 2.87 time: 0.033072 Apr 21 14:07:25 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 123/365] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:07:25 2023] GET /compute/v2.1/servers/4a44d9f3-28b2-45e7-b952-2bb1735ef5b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:26 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:07:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-86554e91-1f97-4d0a-8ba1-1d8089d54eda tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 204 len: 0 microversion: 2.87 time: 0.124150 Apr 21 14:07:26 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 121/366] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 14:07:25 2023] DELETE /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:26 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '132913991f8c45c1adaf5db7ef7cea30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '885cdc1521a14985bfa70ae21e73c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ca2760b1-37ea-44aa-989a-b7820cee7d70 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 200 len: 1697 microversion: 2.87 time: 0.269602 Apr 21 14:07:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:07:26 2023] GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 1697 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 14:07:26 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "name": "network-vif-unplugged", "status": "completed", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:26 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:26 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:26 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:26 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] Creating event network-vif-unplugged:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 14:07:26 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-a3edbfca-65ad-4dad-a383-ead35bc45217 req-10f0cb1e-4aaf-41e7-9ca4-c2988188a9b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028297 Apr 21 14:07:26 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:27 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "name": "network-vif-deleted", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] Creating event network-vif-deleted:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 14:07:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-bd5fafc6-6e96-4652-a9cd-ea5cf1de0ad9 req-1050a05c-cd27-41d7-892a-1f656dc0d2ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050313 Apr 21 14:07:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 122/369] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:07:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "name": "network-vif-plugged", "status": "completed", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] Creating event network-vif-plugged:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:07:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7fb261aa-f062-4549-8ae6-24d50c9d6bff req-17d8cd3a-7b92-4903-912d-69422a71761b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Apr 21 14:07:27 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 124/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:28 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e502c4c-a46b-4670-acba-2fda2d05adf5", "name": "network-vif-plugged", "status": "completed", "tag": "9ba354a7-6fb2-4eb1-96f4-edb58950895e"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:28 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:28 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:28 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:28 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] Creating event network-vif-plugged:9ba354a7-6fb2-4eb1-96f4-edb58950895e for instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 on user Apr 21 14:07:28 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-c11b2b2d-98f1-4e8b-b605-b76385f91620 req-5a2cbe78-4b6f-4e50-aef4-a13ca1febedc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031321 Apr 21 14:07:28 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:31 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d9eba43d-0a10-41ed-ae74-d07b763c80b6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.226375 Apr 21 14:07:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 123/372] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:30 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:31 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:31 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3c5801a8-b28a-4d9e-8075-ae770685e25d tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.239926 Apr 21 14:07:31 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:31 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:34 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:34 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f1621604-cd4c-4e22-8c8f-d46300dc9aa0 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 200 len: 1545 microversion: 2.1 time: 0.210952 Apr 21 14:07:34 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 126/374] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:34 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 1545 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] [instance: 30068c4a-94ed-4b84-9178-0d554326fc68] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] HTTP exception thrown: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Request method failure captured: Apr 21 14:07:35 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 HTTP/1.1 Apr 21 14:07:35 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:07:35 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:07:35 user devstack@n-api.service[61727]: Connection: close Apr 21 14:07:35 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:07:35 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:07:35 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:07:35 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:07:35 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpZrHhetEbJ-eR0NAhsQRkYqGC0-B8Hrf1Le-0OfWDXDhJl-4Budjrxrc0fMUZ5kEjcSeZCoy6xibDD-fdFY2icwIX0nlYakQjXzLSHqEoqsAI4ag6kutCryoyoDpIIbLzDuy6NPCN_hwBhmH6gI8LPYRI9bhW0yTYQWaGl2A_gK5kU Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Project-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c210480b33473c91156b798bcbd8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Tenant: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Tenant-Id: a8c210480b33473c91156b798bcbd8b2 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1552178734 Apr 21 14:07:35 user devstack@n-api.service[61727]: X-User: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:07:35 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:07:35 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:07:35 user devstack@n-api.service[61727]: X-User-Id: 2259f365261c49b28b56ddd1c27c125d Apr 21 14:07:35 user devstack@n-api.service[61727]: X-User-Name: tempest-ServersNegativeTestJSON-1552178734-project-member Apr 21 14:07:35 user devstack@n-api.service[61727]: method: > Apr 21 14:07:35 user devstack@n-api.service[61727]: exception: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. Apr 21 14:07:35 user devstack@n-api.service[61727]: action_args: {'id': '30068c4a-94ed-4b84-9178-0d554326fc68'} Apr 21 14:07:35 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. Apr 21 14:07:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:07:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] Returning 404 to user: Instance 30068c4a-94ed-4b84-9178-0d554326fc68 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:07:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-6720bcc9-668b-4a5d-a73a-cabfec5b3ba2 tempest-ServersNegativeTestJSON-1552178734 tempest-ServersNegativeTestJSON-1552178734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68" status: 404 len: 111 microversion: 2.1 time: 0.029699 Apr 21 14:07:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:35 2023] GET /compute/v2.1/servers/30068c4a-94ed-4b84-9178-0d554326fc68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=20 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:53 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:07:53 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-fdcc1557-6761-4bdb-adbc-f092c02927cc tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 204 len: 0 microversion: 2.1 time: 0.112931 Apr 21 14:07:53 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:07:53 2023] DELETE /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=12 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-unplugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] Creating event network-vif-unplugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:07:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7bad4b8d-6a68-40af-8e81-13c26ec51d94 req-8c1d0761-a2b2-48a7-a003-86fe5ca015d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037763 Apr 21 14:07:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 125/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:53 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:07:53 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-9f3ecf6f-982f-4009-bbdc-961fc4d35ff1 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 200 len: 1495 microversion: 2.1 time: 0.248244 Apr 21 14:07:53 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 127/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:07:53 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 1495 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:07:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-deleted", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] Creating event network-vif-deleted:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:07:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-0a9b56ba-b4a7-4f89-9b41-9c28e49b54d6 req-e6c30c1f-64b3-4a71-967f-20e6980667b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033018 Apr 21 14:07:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:07:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80eb182f-948b-42d3-999b-339c5d615a73", "name": "network-vif-plugged", "status": "completed", "tag": "def6080a-bf3f-4516-8140-08f463f69eb7"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:07:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:07:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:07:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:07:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] Creating event network-vif-plugged:def6080a-bf3f-4516-8140-08f463f69eb7 for instance 80eb182f-948b-42d3-999b-339c5d615a73 on user Apr 21 14:07:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-8d93d224-88fd-4bf2-9894-e7f1e70bcb2d req-c3e244c1-8f1e-4112-acb6-9b13dae48274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Apr 21 14:07:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:10 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:08:10 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-0341a9fb-90ad-43b8-bc20-119f5e337aba tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 200 len: 1537 microversion: 2.1 time: 0.365076 Apr 21 14:08:10 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:08:10 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] [instance: 5e502c4c-a46b-4670-acba-2fda2d05adf5] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] HTTP exception thrown: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Request method failure captured: Apr 21 14:08:16 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 HTTP/1.1 Apr 21 14:08:16 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:08:16 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:08:16 user devstack@n-api.service[61728]: Connection: close Apr 21 14:08:16 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:08:16 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:08:16 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:08:16 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:08:16 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpad2XAJY_EVWPQTnxrvDioSABfj6II45t5vWSvPyBRiUDGQz75AWz6Hz6S9OL_zvbL0lcykuWwymdIceJzKJZEayJ6C2tZB_fnO8gLqvbNjjWJhwT7WYgnXs260NkX5cSFRwsUQYER4NF3tPjor4lyftN992gmubrZy4jb_cITA0qY Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Project-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/885cdc1521a14985bfa70ae21e73c693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Tenant-Id: 885cdc1521a14985bfa70ae21e73c693 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-User: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:08:16 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:08:16 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:08:16 user devstack@n-api.service[61728]: X-User-Id: 132913991f8c45c1adaf5db7ef7cea30 Apr 21 14:08:16 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member Apr 21 14:08:16 user devstack@n-api.service[61728]: method: > Apr 21 14:08:16 user devstack@n-api.service[61728]: exception: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. Apr 21 14:08:16 user devstack@n-api.service[61728]: action_args: {'id': '5e502c4c-a46b-4670-acba-2fda2d05adf5'} Apr 21 14:08:16 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. Apr 21 14:08:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:08:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] Returning 404 to user: Instance 5e502c4c-a46b-4670-acba-2fda2d05adf5 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:08:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-a6557763-f519-4e5b-a05e-f41cc5d7ee86 tempest-ServerBootFromVolumeStableRescueTest-28514522 tempest-ServerBootFromVolumeStableRescueTest-28514522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5" status: 404 len: 111 microversion: 2.87 time: 0.036103 Apr 21 14:08:16 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 128/382] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 14:08:16 2023] GET /compute/v2.1/servers/5e502c4c-a46b-4670-acba-2fda2d05adf5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:33 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:08:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9418feb7-5de0-46a4-9fc6-68812fb06b6a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.492305 Apr 21 14:08:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 127/383] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:08:32 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:34 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-c03ba2ac-9761-4011-a0cb-42b5300b3406 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165720 Apr 21 14:08:34 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 129/384] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:08:34 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] Creating event network-changed:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:08:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-2b7d65fa-67d8-42d8-80ac-c06009afdf48 req-293defd7-c5f1-4bb0-a35e-98ba53d84ec8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031364 Apr 21 14:08:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-73a51e15-49d8-49e3-85bc-b6b5443044e1 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1/ips" status: 200 len: 109 microversion: 2.1 time: 0.033499 Apr 21 14:08:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 128/386] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:08:35 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1/ips => generated 109 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:37 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:08:37 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4e6a6b0d-bd5f-4c8c-8387-d096beab8f20 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 204 len: 0 microversion: 2.1 time: 0.107747 Apr 21 14:08:37 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:08:36 2023] DELETE /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "name": "network-vif-unplugged", "status": "completed", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] Creating event network-vif-unplugged:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:08:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-f2267aa3-5b39-43e0-872c-20ae56a7a345 req-5815018d-a7d6-4a45-957c-e46f1e8c1bca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044045 Apr 21 14:08:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:37 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:08:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1db61531-a940-4d6f-b2cc-7c8bd900ffd8 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 200 len: 1670 microversion: 2.1 time: 0.726594 Apr 21 14:08:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 130/389] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:08:37 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 1670 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:08:39 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}, {"server_uuid": "91696ea3-6e52-4506-ba4d-7f87f7b9f5b1", "name": "network-vif-deleted", "tag": "0b9909b1-cbc2-4a32-9744-599b789730dc"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:39 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Creating event network-vif-plugged:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:08:39 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] Creating event network-vif-deleted:0b9909b1-cbc2-4a32-9744-599b789730dc for instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 on user Apr 21 14:08:39 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-5c2746cd-a667-41de-9f42-cd1d9b593f37 req-a94d3b04-bab9-49d8-ba14-7cb25bb75651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030118 Apr 21 14:08:39 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 131/390] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: 80eb182f-948b-42d3-999b-339c5d615a73] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] HTTP exception thrown: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Request method failure captured: Apr 21 14:08:43 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 HTTP/1.1 Apr 21 14:08:43 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:08:43 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:08:43 user devstack@n-api.service[61727]: Connection: close Apr 21 14:08:43 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:08:43 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:08:43 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:08:43 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:08:43 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpeaA540W5V4jG9PRel913lYUfnOT6i8nss79x9noLWDY0QRgahsyr7DwFj0N-q53Dd2b0RQQw7sdxArRSz2YZPIL2meg6NDzIR1YPE56lo5-mGGAj9mToPCjdI5kv-75rbI5Y3S-LaLTwx9MfwZuYdGtZMwCSVFcq8W0pDPoHkOtoE Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Project-Id: 432a123307454a44922597d6c9089447 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/432a123307454a44922597d6c9089447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/432a123307454a44922597d6c9089447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/432a123307454a44922597d6c9089447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Tenant-Id: 432a123307454a44922597d6c9089447 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-User: tempest-ServerRescueNegativeTestJSON-193683719-project-member Apr 21 14:08:43 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:08:43 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:08:43 user devstack@n-api.service[61727]: X-User-Id: 4df58f0cb48f4aa29df57f9c2f632782 Apr 21 14:08:43 user devstack@n-api.service[61727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-193683719-project-member Apr 21 14:08:43 user devstack@n-api.service[61727]: method: > Apr 21 14:08:43 user devstack@n-api.service[61727]: exception: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. Apr 21 14:08:43 user devstack@n-api.service[61727]: action_args: {'id': '80eb182f-948b-42d3-999b-339c5d615a73'} Apr 21 14:08:43 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. Apr 21 14:08:43 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:08:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Returning 404 to user: Instance 80eb182f-948b-42d3-999b-339c5d615a73 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:08:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9d9ab3ab-af7f-4168-9239-51b337bee751 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73" status: 404 len: 111 microversion: 2.1 time: 0.131283 Apr 21 14:08:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:08:43 2023] GET /compute/v2.1/servers/80eb182f-948b-42d3-999b-339c5d615a73 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:43 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:08:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-8924b070-ed80-4e2a-8ad3-f8d23e021274 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014" status: 204 len: 0 microversion: 2.1 time: 0.115848 Apr 21 14:08:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 131/392] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:08:43 2023] DELETE /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:43 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "name": "network-vif-unplugged", "status": "completed", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] Creating event network-vif-unplugged:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:08:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-2ec1a305-8af9-40cc-95e3-4f0984104e2c req-23f8b0eb-e97d-438c-a43d-aeba06693c1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097389 Apr 21 14:08:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 131/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:44 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df58f0cb48f4aa29df57f9c2f632782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432a123307454a44922597d6c9089447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:08:44 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4a9e5463-fc9f-44c0-bee7-cbcc5db27cda tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014" status: 200 len: 1511 microversion: 2.1 time: 0.314570 Apr 21 14:08:44 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 132/394] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:08:43 2023] GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:08:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "name": "network-vif-deleted", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] Creating event network-vif-deleted:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:08:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7f4d7511-269e-463d-a5cf-b7dc8f5befa8 req-b755f04b-d269-496d-a306-dc524e621021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027683 Apr 21 14:08:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:08:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a205a2a4-c0de-4c5c-abc4-7b034070e014", "name": "network-vif-plugged", "status": "completed", "tag": "10363ff5-34d7-4af3-bd72-c7cb78d665c9"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:08:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:08:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:08:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:08:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] Creating event network-vif-plugged:10363ff5-34d7-4af3-bd72-c7cb78d665c9 for instance a205a2a4-c0de-4c5c-abc4-7b034070e014 on user Apr 21 14:08:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-dc6070ee-fcf7-4df7-bf15-9857a5300c17 req-4e5c8397-f450-4af6-83a9-8236dc0549e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Apr 21 14:08:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 132/396] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:08:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:10 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:11 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:11 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-53f5c9de-66e2-400e-9ca0-13cfc6f2850e tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 200 len: 1537 microversion: 2.1 time: 0.257324 Apr 21 14:09:11 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:10 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Searching by: {'deleted': False, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982'} {{(pid=61728) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:11 user devstack@n-api.service[61728]: DEBUG nova.compute.multi_cell_list [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61728) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 14:09:11 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5822e281-9b2b-496d-8885-8ebeea019b1f tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.071771 Apr 21 14:09:11 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 14:09:11 2023] GET /compute/v2.1/servers => generated 341 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=18 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:11 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1746a543-2e22-443d-b0c1-7d2a8db3b8b1 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 200 len: 1537 microversion: 2.1 time: 0.230203 Apr 21 14:09:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:11 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:12 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:09:12 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b0e2096f-8790-45c5-a8c7-1c2902592676 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 204 len: 0 microversion: 2.1 time: 0.100139 Apr 21 14:09:12 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:09:12 2023] DELETE /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:13 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d40cdc3312b43d286d8a79cde9f5418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa1f4e6f7864477b911420ea2ecb982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:13 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-432cf973-8d24-4b5c-91d2-b08f6d9e4a29 tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 200 len: 1543 microversion: 2.1 time: 0.186632 Apr 21 14:09:13 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:12 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 1543 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "name": "network-vif-unplugged", "status": "completed", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] Creating event network-vif-unplugged:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:09:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-ee0b6e80-edbc-4d81-ade0-1e274f4a42a0 req-d1764f54-7b7e-4830-8acc-6a97221bf27d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029618 Apr 21 14:09:13 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 134/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:14 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "name": "network-vif-deleted", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:14 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:14 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] Creating event network-vif-deleted:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:09:14 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-88d422c3-8917-4025-a633-8b4508a92b2d req-0f2f1a73-2355-44f0-9ff7-ba7650c9c49f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027286 Apr 21 14:09:14 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb793e62-10c7-4bc3-834b-4a046bd33462", "name": "network-vif-plugged", "status": "completed", "tag": "5aa6dd25-1817-44da-9879-ccebac68be61"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] Creating event network-vif-plugged:5aa6dd25-1817-44da-9879-ccebac68be61 for instance eb793e62-10c7-4bc3-834b-4a046bd33462 on user Apr 21 14:09:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-e80d0b45-29bd-4377-b1b0-c5510bc7b410 req-c69f362e-5768-4418-a6fe-a9e60cc52890 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027780 Apr 21 14:09:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:27 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:27 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:27 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:27 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:09:28 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 HTTP/1.1 Apr 21 14:09:28 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:09:28 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:09:28 user devstack@n-api.service[61727]: Connection: close Apr 21 14:09:28 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:09:28 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:09:28 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:09:28 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:09:28 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:09:28 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:09:28 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:09:28 user devstack@n-api.service[61727]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:09:28 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:09:28 user devstack@n-api.service[61727]: method: > Apr 21 14:09:28 user devstack@n-api.service[61727]: exception: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:09:28 user devstack@n-api.service[61727]: action_args: {'id': '91696ea3-6e52-4506-ba4d-7f87f7b9f5b1'} Apr 21 14:09:28 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:09:28 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:09:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:09:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1b98ba4c-dc45-427a-b950-c51eab6f28bd tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 404 len: 111 microversion: 2.1 time: 0.148264 Apr 21 14:09:28 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:27 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:09:28 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:28 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:28 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-2657dc8b-14cd-4e94-a585-371f6de6c041 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '.version_select at 0x7f160e0993f0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:28 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-2657dc8b-14cd-4e94-a585-371f6de6c041 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571092211" status: 202 len: 0 microversion: 2.1 time: 0.038464 Apr 21 14:09:28 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 14:09:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571092211 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1de498fe-af40-4ee1-8dd6-571be6134e09 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: .version_select at 0x7f160e095510>, body: {"keypair": {"name": "tempest-keypair-1225044309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh3h/ls9Vz2CSJMa9VpcyU76RLbRZmuJQ248SapA8bgNUNmhAl7IYjCs169Izl/iH7Dan2D0JBNyZec2ol4KFoZzjxYCOpbOA18fLh9nA4MO8xkGTV3gPFpF/O9TMHYqw=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-1de498fe-af40-4ee1-8dd6-571be6134e09 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:09:28 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-1de498fe-af40-4ee1-8dd6-571be6134e09 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:09:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1de498fe-af40-4ee1-8dd6-571be6134e09 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052855 Apr 21 14:09:28 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 136/407] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:09:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:30 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-911419057", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "31b07b9f-0a0f-426a-97d6-12b23e611818"}], "security_groups": [{"name": "tempest-securitygroup--1300190058"}], "key_name": "tempest-keypair-1225044309", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:30 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] validate_networks() for [('31b07b9f-0a0f-426a-97d6-12b23e611818', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Getting quotas for user ab1d2ed7df2f4a9bbf14da7e2c5fece2 and project f0ccc2c950364fcbb0f2b1cc937f6a82. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:09:31 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:09:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f53650d5-49c4-4775-86b0-98020eb97ff7 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.024213 Apr 21 14:09:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 136/408] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:09:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:09:31 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a7d9b283-3b2a-42e6-90be-b89c729a2e39 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:31 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a7d9b283-3b2a-42e6-90be-b89c729a2e39 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:31 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-a7d9b283-3b2a-42e6-90be-b89c729a2e39 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:31 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a7d9b283-3b2a-42e6-90be-b89c729a2e39 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 200 len: 1235 microversion: 2.1 time: 0.070962 Apr 21 14:09:31 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:31 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:33 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:33 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-27e6cce8-8e20-4b4c-89c9-5e167b76d766 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.446876 Apr 21 14:09:33 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:33 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-919dd3f6-cf43-4171-9268-f8e0e3adf0c0 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.354968 Apr 21 14:09:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 137/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:33 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] [instance: a205a2a4-c0de-4c5c-abc4-7b034070e014] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] HTTP exception thrown: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Request method failure captured: Apr 21 14:09:34 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 HTTP/1.1 Apr 21 14:09:34 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:09:34 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:09:34 user devstack@n-api.service[61728]: Connection: close Apr 21 14:09:34 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:09:34 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:09:34 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:09:34 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:09:34 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpeaA540W5V4jG9PRel913lYUfnOT6i8nss79x9noLWDY0QRgahsyr7DwFj0N-q53Dd2b0RQQw7sdxArRSz2YZPIL2meg6NDzIR1YPE56lo5-mGGAj9mToPCjdI5kv-75rbI5Y3S-LaLTwx9MfwZuYdGtZMwCSVFcq8W0pDPoHkOtoE Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Project-Id: 432a123307454a44922597d6c9089447 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/432a123307454a44922597d6c9089447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/432a123307454a44922597d6c9089447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/432a123307454a44922597d6c9089447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Tenant-Id: 432a123307454a44922597d6c9089447 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-193683719 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-User: tempest-ServerRescueNegativeTestJSON-193683719-project-member Apr 21 14:09:34 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:09:34 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:09:34 user devstack@n-api.service[61728]: X-User-Id: 4df58f0cb48f4aa29df57f9c2f632782 Apr 21 14:09:34 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-193683719-project-member Apr 21 14:09:34 user devstack@n-api.service[61728]: method: > Apr 21 14:09:34 user devstack@n-api.service[61728]: exception: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. Apr 21 14:09:34 user devstack@n-api.service[61728]: action_args: {'id': 'a205a2a4-c0de-4c5c-abc4-7b034070e014'} Apr 21 14:09:34 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. Apr 21 14:09:34 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:09:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] Returning 404 to user: Instance a205a2a4-c0de-4c5c-abc4-7b034070e014 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:09:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-79bf912d-d664-4c51-8f82-4c8f23f38db5 tempest-ServerRescueNegativeTestJSON-193683719 tempest-ServerRescueNegativeTestJSON-193683719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014" status: 404 len: 111 microversion: 2.1 time: 0.033239 Apr 21 14:09:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:34 2023] GET /compute/v2.1/servers/a205a2a4-c0de-4c5c-abc4-7b034070e014 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:09:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] Creating event network-changed:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:09:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7126fc34-586f-4c40-ac58-decbeee3c2a4 req-deb743fe-fa39-4688-a14b-8e93c34b84ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035096 Apr 21 14:09:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:34 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:09:34 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-f2b141a1-026c-401d-bde3-0edd06aefccd tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.301068 Apr 21 14:09:34 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:09:34 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:09:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "name": "network-vif-plugged", "status": "completed", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] Creating event network-vif-plugged:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:09:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-82321f00-08b6-44f8-b94b-a3a3b53a3925 req-fea7597a-a650-47ab-a2b9-38ba16825999 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030041 Apr 21 14:09:36 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:09:38 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "name": "network-vif-plugged", "status": "completed", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:09:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:09:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:09:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:09:38 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] Creating event network-vif-plugged:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:09:38 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-24937e3c-8189-4867-b3d9-a9c7f1e9f6ea req-8380ef52-c49e-4d22-9422-98e25fcac1d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052123 Apr 21 14:09:38 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 139/416] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] [instance: eb793e62-10c7-4bc3-834b-4a046bd33462] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:03 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] HTTP exception thrown: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Request method failure captured: Apr 21 14:10:03 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 HTTP/1.1 Apr 21 14:10:03 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:10:03 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:10:03 user devstack@n-api.service[61726]: Connection: close Apr 21 14:10:03 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:10:03 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:10:03 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:10:03 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:10:03 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpfmOoBcxbYlVsJcc9b1Ee7MB1lR3OZjunFYeMxJQnu3GKc8H8-llB0Zez0Qga0vpmoZMOA0wL_hbZqaMf7kTxyF2lKT9DDby5n0X1baBwIJ2xxVI2LwCN0OEUf3_FOY0tu2OdiJQr0-EqLkWVek6VCZLg8IZGyz9Joukt4giu2IV8k Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Project-Id: cfa1f4e6f7864477b911420ea2ecb982 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Project-Name: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfa1f4e6f7864477b911420ea2ecb982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Tenant: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Tenant-Id: cfa1f4e6f7864477b911420ea2ecb982 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-TestMinimumBasicScenario-515927679 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-User: tempest-TestMinimumBasicScenario-515927679-project-member Apr 21 14:10:03 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:10:03 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:10:03 user devstack@n-api.service[61726]: X-User-Id: 9d40cdc3312b43d286d8a79cde9f5418 Apr 21 14:10:03 user devstack@n-api.service[61726]: X-User-Name: tempest-TestMinimumBasicScenario-515927679-project-member Apr 21 14:10:03 user devstack@n-api.service[61726]: method: > Apr 21 14:10:03 user devstack@n-api.service[61726]: exception: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. Apr 21 14:10:03 user devstack@n-api.service[61726]: action_args: {'id': 'eb793e62-10c7-4bc3-834b-4a046bd33462'} Apr 21 14:10:03 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. Apr 21 14:10:03 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:10:03 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Returning 404 to user: Instance eb793e62-10c7-4bc3-834b-4a046bd33462 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:10:03 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-27f8ca31-4cc5-46d5-ad19-6db26618d8cb tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462" status: 404 len: 111 microversion: 2.1 time: 0.266772 Apr 21 14:10:03 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:10:03 2023] GET /compute/v2.1/servers/eb793e62-10c7-4bc3-834b-4a046bd33462 => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:10:03 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2370be50-a60f-4209-88c8-695318f1f20a tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] Calling method '.version_select at 0x7f160e097760>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:10:03 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-2370be50-a60f-4209-88c8-695318f1f20a tempest-TestMinimumBasicScenario-515927679 tempest-TestMinimumBasicScenario-515927679-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-788075712" status: 202 len: 0 microversion: 2.1 time: 0.027674 Apr 21 14:10:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 21 14:10:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-788075712 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:10:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-bf25583e-ac40-4a0b-8c15-b9035630fe22 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 200 len: 1546 microversion: 2.1 time: 0.233936 Apr 21 14:10:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:10:21 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 1546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:10:36 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:10:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4f879de0-1612-4d51-93ff-b641176f53d7 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.229780 Apr 21 14:10:36 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:10:35 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:11:21 user devstack@n-api.service[61728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:11:21 user devstack@n-api.service[61728]: Fri Apr 21 14:11:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0/os-interface (ip 10.0.0.210) !!! Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1f0afd2a-c67f-4760-854f-1f3088c8af7e tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.168333 Apr 21 14:11:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 141/421] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 14:11:21 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0/os-interface => generated 283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:22 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a5a80e46-fd12-48b3-87a6-ac1bbcaa8486 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0/ips" status: 200 len: 109 microversion: 2.1 time: 0.048582 Apr 21 14:11:22 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 14:11:22 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0/ips => generated 109 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] Creating event network-changed:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:11:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-fb983fb5-56a4-4a18-8fe9-a8ec09fd1fae req-bc684b89-c159-498f-b7d6-a1c79b83e6ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210332 Apr 21 14:11:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 141/423] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:11:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:24 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:11:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b33eeaa5-4d8a-48b3-821c-1df8d34b9e25 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 204 len: 0 microversion: 2.1 time: 0.118441 Apr 21 14:11:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:11:24 2023] DELETE /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:24 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1d2ed7df2f4a9bbf14da7e2c5fece2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ccc2c950364fcbb0f2b1cc937f6a82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:11:24 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-b9951a7c-8ede-4a03-872e-11a8f32b704f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 200 len: 1671 microversion: 2.1 time: 0.611605 Apr 21 14:11:24 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:11:24 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 1671 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:11:24 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "name": "network-vif-unplugged", "status": "completed", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:11:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] Creating event network-vif-unplugged:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:11:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-9eff4fd3-93d1-4b20-ae7c-27f30c2a743e req-000e5176-02c8-47cb-80c0-67b2d9b225e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035878 Apr 21 14:11:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:11:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "name": "network-vif-plugged", "status": "completed", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}, {"server_uuid": "4a52be06-ff23-47fa-8f3f-ecd2e4045df0", "name": "network-vif-deleted", "tag": "2ae823dd-90e2-45a4-a300-3ea150d56569"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:11:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Creating event network-vif-plugged:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:11:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] Creating event network-vif-deleted:2ae823dd-90e2-45a4-a300-3ea150d56569 for instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 on user Apr 21 14:11:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-671231d5-8d93-40a4-9b97-5e422c01a93f req-fc0ad880-5d69-4a26-96f8-56682085fdee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028600 Apr 21 14:11:27 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 143/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=10 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:11:36 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-e2c1d9dd-f371-4c5b-ac17-2234c38f30ac tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.278412 Apr 21 14:11:36 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:11:36 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:11:36 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d3c21368-6b73-4c69-8eed-43439c23bb3a tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.226129 Apr 21 14:11:36 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:11:36 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:11:36 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:11:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b5e3481d-4317-47ff-a10b-705fca0ae768 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.144373 Apr 21 14:11:36 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:11:36 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:15 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 HTTP/1.1 Apr 21 14:12:15 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:12:15 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:12:15 user devstack@n-api.service[61726]: Connection: close Apr 21 14:12:15 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:12:15 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:12:15 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:12:15 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:12:15 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61726]: method: > Apr 21 14:12:15 user devstack@n-api.service[61726]: exception: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: action_args: {'id': '4a52be06-ff23-47fa-8f3f-ecd2e4045df0'} Apr 21 14:12:15 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-04beb5e7-c99e-4cbb-9d29-e59390c3904f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 404 len: 111 microversion: 2.1 time: 0.033335 Apr 21 14:12:15 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 144/431] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:15 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fde03673-c436-4e43-82fe-a363b67f95c3 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '.version_select at 0x7f160df3acb0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:15 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fde03673-c436-4e43-82fe-a363b67f95c3 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225044309" status: 202 len: 0 microversion: 2.1 time: 0.026372 Apr 21 14:12:15 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 144/432] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:12:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225044309 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:15 user devstack@n-api.service[61728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 21 14:12:15 user devstack@n-api.service[61728]: Fri Apr 21 14:12:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 (ip 10.0.0.210) !!! Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:15 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 HTTP/1.1 Apr 21 14:12:15 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:12:15 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:12:15 user devstack@n-api.service[61728]: Connection: close Apr 21 14:12:15 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:12:15 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:12:15 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:12:15 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:12:15 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61728]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:15 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61728]: method: > Apr 21 14:12:15 user devstack@n-api.service[61728]: exception: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61728]: action_args: {'id': '4a52be06-ff23-47fa-8f3f-ecd2e4045df0'} Apr 21 14:12:15 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c71cb7f-ee76-49e0-a3f1-e1e6d4bc9286 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 404 len: 111 microversion: 2.1 time: 0.073397 Apr 21 14:12:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 145/433] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:12:15 2023] DELETE /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 4a52be06-ff23-47fa-8f3f-ecd2e4045df0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:15 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:15 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 HTTP/1.1 Apr 21 14:12:15 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:12:15 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:12:15 user devstack@n-api.service[61726]: Connection: close Apr 21 14:12:15 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:12:15 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:12:15 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:12:15 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:12:15 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:15 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:15 user devstack@n-api.service[61726]: method: > Apr 21 14:12:15 user devstack@n-api.service[61726]: exception: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: action_args: {'id': '4a52be06-ff23-47fa-8f3f-ecd2e4045df0'} Apr 21 14:12:15 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:15 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 4a52be06-ff23-47fa-8f3f-ecd2e4045df0 could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:16 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-5dc14d87-4159-41c1-835e-de5c9b2a800d tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0" status: 404 len: 111 microversion: 2.1 time: 0.026166 Apr 21 14:12:16 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:15 2023] GET /compute/v2.1/servers/4a52be06-ff23-47fa-8f3f-ecd2e4045df0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:16 user devstack@n-api.service[61727]: request: DELETE /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 HTTP/1.1 Apr 21 14:12:16 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:12:16 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:12:16 user devstack@n-api.service[61727]: Connection: close Apr 21 14:12:16 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:12:16 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:12:16 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:12:16 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:12:16 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61727]: method: > Apr 21 14:12:16 user devstack@n-api.service[61727]: exception: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: action_args: {'id': '91696ea3-6e52-4506-ba4d-7f87f7b9f5b1'} Apr 21 14:12:16 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c5c8f1b9-6eaa-4bac-b6fa-473f31c4496f tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 404 len: 111 microversion: 2.1 time: 0.026231 Apr 21 14:12:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:12:16 2023] DELETE /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:16 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 HTTP/1.1 Apr 21 14:12:16 user devstack@n-api.service[61728]: Accept: application/json Apr 21 14:12:16 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 21 14:12:16 user devstack@n-api.service[61728]: Connection: close Apr 21 14:12:16 user devstack@n-api.service[61728]: Content-Length: 0 Apr 21 14:12:16 user devstack@n-api.service[61728]: Content-Type: application/json Apr 21 14:12:16 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 21 14:12:16 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 21 14:12:16 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Role: reader,member Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61728]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:16 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61728]: method: > Apr 21 14:12:16 user devstack@n-api.service[61728]: exception: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61728]: action_args: {'id': '91696ea3-6e52-4506-ba4d-7f87f7b9f5b1'} Apr 21 14:12:16 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. Apr 21 14:12:16 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance 91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b89573c3-153a-40a0-bd43-1e6060f88f81 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1" status: 404 len: 111 microversion: 2.1 time: 0.026595 Apr 21 14:12:16 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:16 2023] GET /compute/v2.1/servers/91696ea3-6e52-4506-ba4d-7f87f7b9f5b1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:16 user devstack@n-api.service[61726]: request: DELETE /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd HTTP/1.1 Apr 21 14:12:16 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:12:16 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:12:16 user devstack@n-api.service[61726]: Connection: close Apr 21 14:12:16 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:12:16 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:12:16 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:12:16 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:12:16 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61726]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:16 user devstack@n-api.service[61726]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61726]: method: > Apr 21 14:12:16 user devstack@n-api.service[61726]: exception: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: action_args: {'id': 'aac5a363-5528-4d5f-8c90-6f9ad69a06dd'} Apr 21 14:12:16 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:16 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-4c249d58-a343-4fb8-a598-13156f6b28b9 tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 404 len: 111 microversion: 2.1 time: 0.032970 Apr 21 14:12:16 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:12:16 2023] DELETE /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] [instance: aac5a363-5528-4d5f-8c90-6f9ad69a06dd] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] HTTP exception thrown: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Request method failure captured: Apr 21 14:12:16 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd HTTP/1.1 Apr 21 14:12:16 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:12:16 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:12:16 user devstack@n-api.service[61727]: Connection: close Apr 21 14:12:16 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:12:16 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:12:16 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:12:16 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:12:16 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpfLYEhAqBxwJrftON8LRLY4KLJVmFRJr5aDTh0tg4nojpOBPbh_z3lR_SK5lWtL5sD3t4mJD15Zrg37YkdDIIM75cR0OgS4YP0RJIuZUgGjV47qtopFEh1M28N0L0Eh31dRxPVyWtu5PiPbiObcEO4SiXUzK9JxwLRntDzyp6w3DQY Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0ccc2c950364fcbb0f2b1cc937f6a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant-Id: f0ccc2c950364fcbb0f2b1cc937f6a82 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166063504 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Id: ab1d2ed7df2f4a9bbf14da7e2c5fece2 Apr 21 14:12:16 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-166063504-project-member Apr 21 14:12:16 user devstack@n-api.service[61727]: method: > Apr 21 14:12:16 user devstack@n-api.service[61727]: exception: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: action_args: {'id': 'aac5a363-5528-4d5f-8c90-6f9ad69a06dd'} Apr 21 14:12:16 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. Apr 21 14:12:16 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:12:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] Returning 404 to user: Instance aac5a363-5528-4d5f-8c90-6f9ad69a06dd could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:12:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1029eb85-43ab-4053-8e84-b144c2428e3c tempest-AttachVolumeNegativeTest-166063504 tempest-AttachVolumeNegativeTest-166063504-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd" status: 404 len: 111 microversion: 2.1 time: 0.026305 Apr 21 14:12:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:16 2023] GET /compute/v2.1/servers/aac5a363-5528-4d5f-8c90-6f9ad69a06dd => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1372418588", "imageRef": "2edfef44-2867-4e03-a53e-b139f99afa75", "flavorRef": "42", "networks": [{"uuid": "42ccd7c8-88c9-488d-930f-e97bbf32973d"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] validate_networks() for [('42ccd7c8-88c9-488d-930f-e97bbf32973d', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Getting quotas for project 5c8eefb268d74734820c0faac7ddb131. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Getting quotas for user a1eadfd22cf841d8924dadda7cc29f6a and project 5c8eefb268d74734820c0faac7ddb131. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 14:12:30 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2edfef44-2867-4e03-a53e-b139f99afa75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 14:12:30 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-91c11184-d9ce-4614-949a-88a288ff4a7f tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.805759 Apr 21 14:12:30 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 147/439] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 14:12:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 14:12:30 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-631e0ff6-5d08-41d4-8086-a7361fb5c57e tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:30 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-631e0ff6-5d08-41d4-8086-a7361fb5c57e tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:30 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:30 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:30 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-631e0ff6-5d08-41d4-8086-a7361fb5c57e tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1eadfd22cf841d8924dadda7cc29f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8eefb268d74734820c0faac7ddb131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:12:30 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-631e0ff6-5d08-41d4-8086-a7361fb5c57e tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0" status: 200 len: 1208 microversion: 2.1 time: 0.065245 Apr 21 14:12:30 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:30 2023] GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 => generated 1208 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] Creating event network-changed:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:12:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-9fcda110-6e35-4d10-b945-103cf8f7b179 req-aa87dd10-928f-4332-b820-b37a20c9930c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Apr 21 14:12:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 147/441] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:12:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "name": "network-vif-plugged", "status": "completed", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:12:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] Creating event network-vif-plugged:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:12:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-bcff33ec-dc9d-45b9-abad-3a8d1b5c5663 req-241347af-0aa4-4546-925e-623571df598c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029148 Apr 21 14:12:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 148/442] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:12:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:12:37 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "name": "network-vif-plugged", "status": "completed", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:12:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:37 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:37 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] Creating event network-vif-plugged:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:12:37 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-955c43e1-83e2-422d-ae19-60f84ddfe59a req-f886bede-3951-4266-9201-725e1b9c3697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Apr 21 14:12:37 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:12:38 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:12:38 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7cbc4434-fc4f-4a41-ba50-638afdcfe22f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1658 microversion: 2.1 time: 0.244147 Apr 21 14:12:38 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:12:38 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1658 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:13:20 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:21 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1eadfd22cf841d8924dadda7cc29f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8eefb268d74734820c0faac7ddb131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:13:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-959054fe-6835-4e18-9fdf-6794e71c58ad tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0" status: 200 len: 1486 microversion: 2.1 time: 0.223992 Apr 21 14:13:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:13:20 2023] GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 => generated 1486 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell0:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=6 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=2 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:39 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Going to try to terminate instance {{(pid=61726) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:13:39 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-56d9b06c-d4f4-4483-b28f-4377f855e728 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 204 len: 0 microversion: 2.1 time: 0.118577 Apr 21 14:13:39 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:13:39 2023] DELETE /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:39 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:39 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f0f10528294c9bb3d4f58f3361c358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c39fcb224f4e69a73734be43ba6588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:13:39 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] Creating event network-vif-unplugged:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:13:39 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a173901b-8914-4b59-803a-b05ea759d71c tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 200 len: 1664 microversion: 2.1 time: 0.435722 Apr 21 14:13:39 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-38799436-2dce-4605-aec0-6f42f10ab668 req-2a605863-7fc8-4d93-83bf-1626ab8baa84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036002 Apr 21 14:13:39 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:13:39 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 1664 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:13:39 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:13:41 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "name": "network-vif-deleted", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:13:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:41 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.compute.server_external_events [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] Creating event network-vif-deleted:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:13:41 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [req-14566ffa-e1ba-4d97-96ff-5cb345d2c40e req-712349d5-dab3-4479-948d-a18beef0fefd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028839 Apr 21 14:13:41 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:13:41 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2e065-1b7d-4cbf-b31a-923ae2f92fff", "name": "network-vif-plugged", "status": "completed", "tag": "7eb11528-a882-4084-a2c7-b36fd432fecf"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:13:41 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:13:41 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:13:41 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:13:41 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] Creating event network-vif-plugged:7eb11528-a882-4084-a2c7-b36fd432fecf for instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff on user Apr 21 14:13:41 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7dc6500a-5c66-4c2e-8222-6c5006420673 req-3e37fdc9-086b-4780-8a0d-6b65485058a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030819 Apr 21 14:13:41 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:22 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 14:14:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e9d15536-32ce-442d-b780-dd8ad6dca655 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0" status: 204 len: 0 microversion: 2.1 time: 0.126806 Apr 21 14:14:22 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 14:14:22 2023] DELETE /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:22 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "name": "network-vif-unplugged", "status": "completed", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:14:23 user devstack@n-api.service[61726]: DEBUG nova.policy [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1eadfd22cf841d8924dadda7cc29f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8eefb268d74734820c0faac7ddb131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61726) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:23 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-e932b1c6-7ba1-4921-a504-92c904af912a tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0" status: 200 len: 1492 microversion: 2.1 time: 0.413543 Apr 21 14:14:23 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:14:22 2023] GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 => generated 1492 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 14:14:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] Creating event network-vif-unplugged:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:14:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-494044eb-39e1-4477-a322-d3689c2b5573 req-657c1f14-c87e-4b4b-8a05-95497986bc98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039381 Apr 21 14:14:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 14:14:25 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "name": "network-vif-plugged", "status": "completed", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}, {"server_uuid": "ff432b87-a8d9-4dfd-9abc-29f93ea545d0", "name": "network-vif-deleted", "tag": "39a38a51-576d-4bf1-a4c1-013343ef291c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:14:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:25 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Creating event network-vif-plugged:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:14:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] Creating event network-vif-deleted:39a38a51-576d-4bf1-a4c1-013343ef291c for instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 on user Apr 21 14:14:25 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-48da5423-e9fc-4ec5-afd0-1d7bac5aa8fa req-3a70199c-6c4b-4785-a4d4-1f9baebf8436 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028776 Apr 21 14:14:25 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 152/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 14:14:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG nova.compute.api [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] [instance: b5e2e065-1b7d-4cbf-b31a-923ae2f92fff] Fetching instance by UUID {{(pid=61726) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG oslo_concurrency.lockutils [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61726) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:14:29 user devstack@n-api.service[61726]: INFO nova.api.openstack.wsgi [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] HTTP exception thrown: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Request method failure captured: Apr 21 14:14:29 user devstack@n-api.service[61726]: request: GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff HTTP/1.1 Apr 21 14:14:29 user devstack@n-api.service[61726]: Accept: application/json Apr 21 14:14:29 user devstack@n-api.service[61726]: Accept-Encoding: identity Apr 21 14:14:29 user devstack@n-api.service[61726]: Connection: close Apr 21 14:14:29 user devstack@n-api.service[61726]: Content-Length: 0 Apr 21 14:14:29 user devstack@n-api.service[61726]: Content-Type: application/json Apr 21 14:14:29 user devstack@n-api.service[61726]: Host: 10.0.0.210 Apr 21 14:14:29 user devstack@n-api.service[61726]: Openstack-System-Scope: None Apr 21 14:14:29 user devstack@n-api.service[61726]: User-Agent: python-urllib3/1.26.15 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Auth-Token: gAAAAABkQpf9o1SH5tAe27Tv6To4QNsCWiK_LM7DobPmeaKE8BgprdO72L__6GqQEZ1JHZCjsqKW2Eb98UcHezMKnr37DF4klTH4AqNkX3IbinOh9gnpTXDFXgR0A1Vm3uLV-6KqhEQL8QydGhENjkZcmGZOl4ncwEfUG48fwevb0O3XkjzmMIg Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Domain-Id: None Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Domain-Name: None Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Identity-Status: Confirmed Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Is-Admin-Project: True Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Project-Domain-Id: default Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Project-Domain-Name: Default Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Project-Id: 41c39fcb224f4e69a73734be43ba6588 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Project-Name: tempest-ServerActionsTestJSON-2051074452 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Role: reader,member Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Roles: reader,member Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41c39fcb224f4e69a73734be43ba6588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41c39fcb224f4e69a73734be43ba6588"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41c39fcb224f4e69a73734be43ba6588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Tenant: tempest-ServerActionsTestJSON-2051074452 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Tenant-Id: 41c39fcb224f4e69a73734be43ba6588 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-Tenant-Name: tempest-ServerActionsTestJSON-2051074452 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-User: tempest-ServerActionsTestJSON-2051074452-project-member Apr 21 14:14:29 user devstack@n-api.service[61726]: X-User-Domain-Id: default Apr 21 14:14:29 user devstack@n-api.service[61726]: X-User-Domain-Name: Default Apr 21 14:14:29 user devstack@n-api.service[61726]: X-User-Id: 95f0f10528294c9bb3d4f58f3361c358 Apr 21 14:14:29 user devstack@n-api.service[61726]: X-User-Name: tempest-ServerActionsTestJSON-2051074452-project-member Apr 21 14:14:29 user devstack@n-api.service[61726]: method: > Apr 21 14:14:29 user devstack@n-api.service[61726]: exception: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. Apr 21 14:14:29 user devstack@n-api.service[61726]: action_args: {'id': 'b5e2e065-1b7d-4cbf-b31a-923ae2f92fff'} Apr 21 14:14:29 user devstack@n-api.service[61726]: {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. Apr 21 14:14:29 user devstack@n-api.service[61726]: ERROR nova.api.openstack.wsgi Apr 21 14:14:29 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Returning 404 to user: Instance b5e2e065-1b7d-4cbf-b31a-923ae2f92fff could not be found. {{(pid=61726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:14:29 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-a7b7a527-6dfe-4234-a60d-22bc0c41bce6 tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff" status: 404 len: 111 microversion: 2.1 time: 0.029679 Apr 21 14:14:29 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 152/455] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:14:29 2023] GET /compute/v2.1/servers/b5e2e065-1b7d-4cbf-b31a-923ae2f92fff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 14:14:29 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-40fa073c-1953-4d53-817a-045a3440711f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] Calling method '.version_select at 0x7f160df3a950>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:14:29 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-40fa073c-1953-4d53-817a-045a3440711f tempest-ServerActionsTestJSON-2051074452 tempest-ServerActionsTestJSON-2051074452-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085847639" status: 202 len: 0 microversion: 2.1 time: 0.027583 Apr 21 14:14:29 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 152/456] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 14:14:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085847639 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:15:05 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:05 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:05 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c25d16ae-1570-47b2-97ae-34857539a771 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] Action: 'create', calling method: .version_select at 0x7f160e037be0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-705793452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNjPYEx3uelrNjj/0yucAYczVAyX9I/AYzh5Gle1A3wbuI0l8xsxlbXO88VzyjjiJycTNHlztRHODp5jQU9iIBlu5mcD0K7hFKJKEFc3iJRsRdKXsuEsr/m3xPhpU+D4A=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 14:15:05 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-c25d16ae-1570-47b2-97ae-34857539a771 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] Getting quotas for project 506d935f4d634d7daaaf4136bdb05e7e. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 14:15:05 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-c25d16ae-1570-47b2-97ae-34857539a771 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] Getting quotas for user 9dc9bbb9f6c44300b3e677e0f7f5edc9 and project 506d935f4d634d7daaaf4136bdb05e7e. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 14:15:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c25d16ae-1570-47b2-97ae-34857539a771 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.056170 Apr 21 14:15:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 153/457] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 14:15:05 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 14:15:08 user devstack@n-api.service[61726]: DEBUG nova.api.openstack.wsgi [None req-2edfb33f-f6b2-493f-bb08-bd698756c361 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] Calling method '.version_select at 0x7f160e099cf0>' {{(pid=61726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:15:08 user devstack@n-api.service[61726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 14:15:08 user devstack@n-api.service[61726]: Fri Apr 21 14:15:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-705793452 (ip 10.0.0.210) !!! Apr 21 14:15:08 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_api:SELECT=4 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:08 user devstack@n-api.service[61726]: DEBUG dbcounter [-] [61726] Writing DB stats nova_cell1:SELECT=8 {{(pid=61726) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:08 user devstack@n-api.service[61726]: INFO nova.api.openstack.requestlog [None req-2edfb33f-f6b2-493f-bb08-bd698756c361 tempest-TestVolumeBootPattern-831669228 tempest-TestVolumeBootPattern-831669228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-705793452" status: 202 len: 0 microversion: 2.1 time: 0.028642 Apr 21 14:15:08 user devstack@n-api.service[61726]: [pid: 61726|app: 0|req: 153/458] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 21 14:15:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-705793452 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] [instance: ff432b87-a8d9-4dfd-9abc-29f93ea545d0] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Acquiring lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Lock "9766f0b7-af82-4ef0-80ec-eb47f9a7deea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 14:15:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] HTTP exception thrown: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Request method failure captured: Apr 21 14:15:13 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 HTTP/1.1 Apr 21 14:15:13 user devstack@n-api.service[61727]: Accept: application/json Apr 21 14:15:13 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 21 14:15:13 user devstack@n-api.service[61727]: Connection: close Apr 21 14:15:13 user devstack@n-api.service[61727]: Content-Length: 0 Apr 21 14:15:13 user devstack@n-api.service[61727]: Content-Type: application/json Apr 21 14:15:13 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 21 14:15:13 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 21 14:15:13 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkQpnMuBLN6eIVhJFFf8EeRgLn7elKNpL96NxfeV1hBYWljvNbAnU4GXVJ_aGiO6Hwzc9qaqBdKwmtZYUy6SqowHgYJT_tY11CWvedIIpB6tVi9vPWQoPckYHKJXGAHEhIFwPopIA4zaO-cqljzbQTsqEor4zDz8GWF7iSXvv8z9nhX3s Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Project-Id: 5c8eefb268d74734820c0faac7ddb131 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesActionsTest-1664293238 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Role: reader,member Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8eefb268d74734820c0faac7ddb131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8eefb268d74734820c0faac7ddb131"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8eefb268d74734820c0faac7ddb131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesActionsTest-1664293238 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Tenant-Id: 5c8eefb268d74734820c0faac7ddb131 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesActionsTest-1664293238 Apr 21 14:15:13 user devstack@n-api.service[61727]: X-User: tempest-VolumesActionsTest-1664293238-project-member Apr 21 14:15:13 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 21 14:15:13 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 21 14:15:13 user devstack@n-api.service[61727]: X-User-Id: a1eadfd22cf841d8924dadda7cc29f6a Apr 21 14:15:13 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesActionsTest-1664293238-project-member Apr 21 14:15:13 user devstack@n-api.service[61727]: method: > Apr 21 14:15:13 user devstack@n-api.service[61727]: exception: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. Apr 21 14:15:13 user devstack@n-api.service[61727]: action_args: {'id': 'ff432b87-a8d9-4dfd-9abc-29f93ea545d0'} Apr 21 14:15:13 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. Apr 21 14:15:13 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 21 14:15:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] Returning 404 to user: Instance ff432b87-a8d9-4dfd-9abc-29f93ea545d0 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 14:15:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e870543d-705b-4223-82a7-7db0503dc8e4 tempest-VolumesActionsTest-1664293238 tempest-VolumesActionsTest-1664293238-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0" status: 404 len: 111 microversion: 2.1 time: 0.035804 Apr 21 14:15:13 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 153/459] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 14:15:13 2023] GET /compute/v2.1/servers/ff432b87-a8d9-4dfd-9abc-29f93ea545d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)