Apr 19 15:35:48 user devstack@n-api.service[72848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 15:35:48 user devstack@n-api.service[72848]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 19 15:35:48 2023] *** Apr 19 15:35:48 user devstack@n-api.service[72848]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 19 15:35:48 user devstack@n-api.service[72848]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 19 15:35:48 user devstack@n-api.service[72848]: nodename: user Apr 19 15:35:48 user devstack@n-api.service[72848]: machine: x86_64 Apr 19 15:35:48 user devstack@n-api.service[72848]: clock source: unix Apr 19 15:35:48 user devstack@n-api.service[72848]: pcre jit disabled Apr 19 15:35:48 user devstack@n-api.service[72848]: detected number of CPU cores: 12 Apr 19 15:35:48 user devstack@n-api.service[72848]: current working directory: / Apr 19 15:35:48 user devstack@n-api.service[72848]: detected binary path: /usr/bin/uwsgi-core Apr 19 15:35:48 user devstack@n-api.service[72848]: your processes number limit is 63637 Apr 19 15:35:48 user devstack@n-api.service[72848]: your memory page size is 4096 bytes Apr 19 15:35:48 user devstack@n-api.service[72848]: detected max file descriptor number: 2048 Apr 19 15:35:48 user devstack@n-api.service[72848]: lock engine: pthread robust mutexes Apr 19 15:35:48 user devstack@n-api.service[72848]: thunder lock: enabled Apr 19 15:35:48 user devstack@n-api.service[72848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 15:35:48 user devstack@n-api.service[72848]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 19 15:35:48 user devstack@n-api.service[72848]: Python main interpreter initialized at 0x55db4f6f0990 Apr 19 15:35:48 user devstack@n-api.service[72848]: python threads support enabled Apr 19 15:35:48 user devstack@n-api.service[72848]: your server socket listen backlog is limited to 100 connections Apr 19 15:35:48 user devstack@n-api.service[72848]: your mercy for graceful operations on workers is 90 seconds Apr 19 15:35:48 user devstack@n-api.service[72848]: mapped 537436 bytes (524 KB) for 3 cores Apr 19 15:35:48 user devstack@n-api.service[72848]: *** Operational MODE: preforking *** Apr 19 15:35:48 user devstack@n-api.service[72848]: *** uWSGI is running in multiple interpreter mode *** Apr 19 15:35:48 user devstack@n-api.service[72848]: spawned uWSGI master process (pid: 72848) Apr 19 15:35:48 user devstack@n-api.service[72848]: spawned uWSGI worker 1 (pid: 72849, cores: 1) Apr 19 15:35:48 user devstack@n-api.service[72848]: spawned uWSGI worker 2 (pid: 72850, cores: 1) Apr 19 15:35:48 user devstack@n-api.service[72848]: spawned uWSGI worker 3 (pid: 72851, cores: 1) Apr 19 15:35:48 user devstack@n-api.service[72848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 15:35:49 user devstack@n-api.service[72851]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 15:35:49 user devstack@n-api.service[72850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 15:35:49 user devstack@n-api.service[72849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 15:35:52 user devstack@n-api.service[72851]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 15:35:52 user devstack@n-api.service[72851]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 15:35:52 user devstack@n-api.service[72851]: and ``live_migration_inbound_addr`` respectively. Apr 19 15:35:52 user devstack@n-api.service[72851]: ). Its value may be silently ignored in the future. Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 15:35:52 user devstack@n-api.service[72850]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 15:35:52 user devstack@n-api.service[72850]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 15:35:52 user devstack@n-api.service[72850]: and ``live_migration_inbound_addr`` respectively. Apr 19 15:35:52 user devstack@n-api.service[72850]: ). Its value may be silently ignored in the future. Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 15:35:53 user devstack@n-api.service[72849]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 15:35:53 user devstack@n-api.service[72849]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 15:35:53 user devstack@n-api.service[72849]: and ``live_migration_inbound_addr`` respectively. Apr 19 15:35:53 user devstack@n-api.service[72849]: ). Its value may be silently ignored in the future. Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72851) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72850) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72851]: INFO dbcounter [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Registered counter for database nova_api Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72850]: INFO dbcounter [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Registered counter for database nova_api Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72849) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_db.sqlalchemy.engines [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72851) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writer thread running {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writer thread running {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.context [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d1abc72-4a1e-46ad-b3ce-2880abea9047(cell1) {{(pid=72851) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG nova.context [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d1abc72-4a1e-46ad-b3ce-2880abea9047(cell1) {{(pid=72850) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72851]: INFO dbcounter [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72850]: INFO dbcounter [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72851]: INFO dbcounter [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Registered counter for database nova_cell1 Apr 19 15:35:53 user devstack@n-api.service[72850]: INFO dbcounter [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Registered counter for database nova_cell1 Apr 19 15:35:53 user devstack@n-api.service[72849]: INFO dbcounter [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Registered counter for database nova_api Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_db.sqlalchemy.engines [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72851) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_db.sqlalchemy.engines [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72851) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writer thread running {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writer thread running {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72849) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writer thread running {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG nova.context [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d1abc72-4a1e-46ad-b3ce-2880abea9047(cell1) {{(pid=72849) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:35:53 user devstack@n-api.service[72849]: INFO dbcounter [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72849]: INFO dbcounter [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Registered counter for database nova_cell1 Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72849) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writer thread running {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72849) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writer thread running {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writer thread running {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72851]: INFO dbcounter [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72850]: INFO dbcounter [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writer thread running {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG oslo_db.sqlalchemy.engines [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72851) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writer thread running {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writer thread running {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72849]: INFO dbcounter [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Registered counter for database nova_cell0 Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72849) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 15:35:53 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writer thread running {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 15:35:53 user devstack@n-api.service[72851]: WARNING keystonemiddleware.auth_token [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:53 user devstack@n-api.service[72850]: WARNING keystonemiddleware.auth_token [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:53 user devstack@n-api.service[72851]: WARNING keystonemiddleware.auth_token [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:53 user devstack@n-api.service[72850]: WARNING keystonemiddleware.auth_token [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:53 user devstack@n-api.service[72851]: WARNING keystonemiddleware.auth_token [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:53 user devstack@n-api.service[72850]: WARNING keystonemiddleware.auth_token [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:53 user devstack@n-api.service[72851]: WARNING keystonemiddleware.auth_token [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:53 user devstack@n-api.service[72850]: WARNING keystonemiddleware.auth_token [None req-6cac99ec-6cb9-44a7-b721-0e3f56241399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:53 user devstack@n-api.service[72851]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db4f6f0990 pid: 72851 (default app) Apr 19 15:35:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:35:53 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001607 Apr 19 15:35:53 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 19 15:35:53 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:35:53 user devstack@n-api.service[72850]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db4f6f0990 pid: 72850 (default app) Apr 19 15:35:53 user devstack@n-api.service[72849]: WARNING keystonemiddleware.auth_token [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:53 user devstack@n-api.service[72849]: WARNING keystonemiddleware.auth_token [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:54 user devstack@n-api.service[72849]: WARNING keystonemiddleware.auth_token [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 15:35:54 user devstack@n-api.service[72849]: WARNING keystonemiddleware.auth_token [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 15:35:54 user devstack@n-api.service[72849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db4f6f0990 pid: 72849 (default app) Apr 19 15:38:02 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:02 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8f31ed93-c472-44f1-8056-53f703e36cfd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001509 Apr 19 15:38:02 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:02 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:02 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:02 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:02 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:03 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-9bf068bc-033a-4689-ab63-13c918af7e42 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:03 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-9bf068bc-033a-4689-ab63-13c918af7e42 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.386779 Apr 19 15:38:03 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 15:38:02 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002339 Apr 19 15:38:05 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:05 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:05 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=3 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:05 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=3 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:05 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=3 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:05 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:05 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-69589920-0f74-475c-b8ea-a773a973f2f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-69589920-0f74-475c-b8ea-a773a973f2f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.319285 Apr 19 15:38:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:05 2023] POST /compute/v2.1/flavors => generated 405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:05 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-8984853f-b934-4ebb-861b-5eb9e6be94f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:05 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-8984853f-b934-4ebb-861b-5eb9e6be94f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048648 Apr 19 15:38:05 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 15:38:05 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:07 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:07 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001461 Apr 19 15:38:07 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:07 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-59d81432-7331-4189-8bd5-79112d526ae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "swap": 0}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-59d81432-7331-4189-8bd5-79112d526ae9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080517 Apr 19 15:38:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:07 2023] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:07 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-6a821f91-ad1f-4bb6-ad50-b1820e740ac1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:07 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-6a821f91-ad1f-4bb6-ad50-b1820e740ac1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026688 Apr 19 15:38:07 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 15:38:07 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:09 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:09 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001530 Apr 19 15:38:09 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:09 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-da226bc3-0a5f-44a7-9150-1bc917d0a2fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "id": "d2", "vcpus": 1, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-da226bc3-0a5f-44a7-9150-1bc917d0a2fe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069026 Apr 19 15:38:09 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:09 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fad25991-019e-4103-8294-4b30930b3428 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-fad25991-019e-4103-8294-4b30930b3428 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024932 Apr 19 15:38:09 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 15:38:09 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:11 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:11 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001583 Apr 19 15:38:11 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:11 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8939f691-cbaf-43ed-82e3-5c06769d43e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "name": "ds2G"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:11 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8939f691-cbaf-43ed-82e3-5c06769d43e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062489 Apr 19 15:38:11 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:11 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:11 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-4918a49d-9f73-443c-a71f-b50ecdd1eea5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:11 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-4918a49d-9f73-443c-a71f-b50ecdd1eea5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027533 Apr 19 15:38:11 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 15:38:11 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:13 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:13 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003316 Apr 19 15:38:13 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:13 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-14f12dee-898d-4b7f-9bd2-84ab35ca38ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-14f12dee-898d-4b7f-9bd2-84ab35ca38ae admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060705 Apr 19 15:38:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:13 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:13 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:13 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079329 Apr 19 15:38:13 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 15:38:13 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:15 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4c7e24d-42cf-41c4-8b02-5a34c2e29165 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001537 Apr 19 15:38:15 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:15 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-04e6e8a1-d595-445d-887a-0866b0878877 admin admin] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:15 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-04e6e8a1-d595-445d-887a-0866b0878877 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069597 Apr 19 15:38:15 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 15:38:15 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:38:17 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:17 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001516 Apr 19 15:38:17 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:17 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-8ef60c7b-7a7d-4715-9533-4b191c2e9d5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "1"}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:18 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-8ef60c7b-7a7d-4715-9533-4b191c2e9d5b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.329498 Apr 19 15:38:18 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:17 2023] POST /compute/v2.1/flavors => generated 400 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:18 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-3ee7d3bc-4c67-455c-9493-b2b0d5ef21c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:18 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-3ee7d3bc-4c67-455c-9493-b2b0d5ef21c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034338 Apr 19 15:38:18 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 15:38:18 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001277 Apr 19 15:38:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-57cf301a-63a3-4f79-9071-32451e0fe9ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-57cf301a-63a3-4f79-9071-32451e0fe9ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064119 Apr 19 15:38:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:20 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-616ae6b9-bd6d-4138-bbd5-ead5ae5cee99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:20 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-616ae6b9-bd6d-4138-bbd5-ead5ae5cee99 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043482 Apr 19 15:38:20 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 15:38:20 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:22 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:22 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001419 Apr 19 15:38:22 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:22 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-f955d99d-6a8f-42f7-91ea-e729acb821b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "swap": 0, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:22 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-f955d99d-6a8f-42f7-91ea-e729acb821b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.235873 Apr 19 15:38:22 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:22 2023] POST /compute/v2.1/flavors => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:22 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-4ad80015-797d-458b-bce7-ae73cfd8851e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:22 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-4ad80015-797d-458b-bce7-ae73cfd8851e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024283 Apr 19 15:38:22 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 15:38:22 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:38:24 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:24 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002282 Apr 19 15:38:24 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:24 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:24 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e9be85c7-5e37-4af0-9807-0c0739710bea admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:24 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e9be85c7-5e37-4af0-9807-0c0739710bea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064827 Apr 19 15:38:24 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:24 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:24 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-d54e0013-b98e-42b8-a95c-57c866d5c61b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:24 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-d54e0013-b98e-42b8-a95c-57c866d5c61b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023407 Apr 19 15:38:24 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 15:38:24 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:38:26 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001377 Apr 19 15:38:26 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 15:38:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:26 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-565f791d-a5d3-4380-ac8a-f424cb786135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "disk": 160}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:26 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-565f791d-a5d3-4380-ac8a-f424cb786135 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079528 Apr 19 15:38:26 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 15:38:26 2023] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:38:26 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-46080e17-78db-448d-898d-e50ea9ea43d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:38:26 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-46080e17-78db-448d-898d-e50ea9ea43d1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026991 Apr 19 15:38:26 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 15:38:26 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:38:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-74ded7d6-6020-4ab1-85d7-824b423c8090 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001373 Apr 19 15:38:57 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 15:38:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:38:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:38:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.097670 Apr 19 15:38:57 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 19 15:38:57 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:39:29 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-46080e17-78db-448d-898d-e50ea9ea43d1 admin admin] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:39:29 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-46080e17-78db-448d-898d-e50ea9ea43d1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001536 Apr 19 15:39:29 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 15:39:29 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:39:29 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:39:29 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a41d8104-a2dc-48c7-b5c7-5224ca054764 admin admin] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:39:29 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-a41d8104-a2dc-48c7-b5c7-5224ca054764 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.069036 Apr 19 15:39:29 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 19 15:39:29 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:39:34 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:39:34 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001652 Apr 19 15:39:34 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 15:39:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:39:34 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:39:34 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-c343a8b0-ece0-4eac-92ea-286b14a13aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 128, "vcpus": 1, "name": "m1.nano", "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:39:34 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-c343a8b0-ece0-4eac-92ea-286b14a13aa0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061635 Apr 19 15:39:34 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 15:39:34 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:39:34 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e2bcd05c-089a-41b4-aa36-6bfa16a73696 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:39:34 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e2bcd05c-089a-41b4-aa36-6bfa16a73696 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025382 Apr 19 15:39:34 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 15:39:34 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:39:38 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:39:38 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1631301e-21c6-40b4-b1a9-f37a7d3b2690 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001545 Apr 19 15:39:38 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 15:39:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:39:38 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-f1061c58-6873-447d-bc47-3decc0225a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "id": "84", "disk": 1, "ram": 192, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:39:38 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-f1061c58-6873-447d-bc47-3decc0225a41 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074512 Apr 19 15:39:38 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 15:39:38 2023] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:39:38 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-469f5f46-87df-4f07-b880-45c81532fdb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:39:38 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-469f5f46-87df-4f07-b880-45c81532fdb1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025982 Apr 19 15:39:38 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 15:39:38 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-00a7e298-dfc6-4484-bd04-d7fc2fde458d tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Action: 'create', calling method: .version_select at 0x7f11e179b0a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-826979820", "metadata": {"Type": "work"}}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-00a7e298-dfc6-4484-bd04-d7fc2fde458d tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:51 user devstack@n-api.service[72849]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:41:51 user devstack@n-api.service[72849]: Connection: close Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Length: 121 Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:41:51 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:41:51 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: Apr 19 15:41:51 user devstack@n-api.service[72849]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-826979820", "metadata": {"Type": "work"}}} Apr 19 15:41:51 user devstack@n-api.service[72849]: method: Apr 19 15:41:51 user devstack@n-api.service[72849]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72849]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-826979820', 'metadata': {'Type': 'work'}}}} Apr 19 15:41:51 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise error Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi '#$%' Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-00a7e298-dfc6-4484-bd04-d7fc2fde458d tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-00a7e298-dfc6-4484-bd04-d7fc2fde458d tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.239182 Apr 19 15:41:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 15:41:51 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:41:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2cc64128-26f9-4727-a207-4d35ba2bb6c6 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Action: 'create', calling method: .version_select at 0x7f11e179ca60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-517297489", "metadata": {"Type": "work"}}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:41:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2cc64128-26f9-4727-a207-4d35ba2bb6c6 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:51 user devstack@n-api.service[72851]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 15:41:51 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:41:51 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:41:51 user devstack@n-api.service[72851]: Connection: close Apr 19 15:41:51 user devstack@n-api.service[72851]: Content-Length: 119 Apr 19 15:41:51 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:41:51 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:41:51 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:41:51 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72851]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:51 user devstack@n-api.service[72851]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72851]: Apr 19 15:41:51 user devstack@n-api.service[72851]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-517297489", "metadata": {"Type": "work"}}} Apr 19 15:41:51 user devstack@n-api.service[72851]: method: Apr 19 15:41:51 user devstack@n-api.service[72851]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 15:41:51 user devstack@n-api.service[72851]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-517297489', 'metadata': {'Type': 'work'}}}} Apr 19 15:41:51 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise error Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi '0' Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 15:41:51 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2cc64128-26f9-4727-a207-4d35ba2bb6c6 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-2cc64128-26f9-4727-a207-4d35ba2bb6c6 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012373 Apr 19 15:41:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 15:41:51 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:41:51 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b551c248-6732-4cbf-ba65-216fc3f24f14 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Action: 'create', calling method: .version_select at 0x7f11e176a950>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1962607467", "metadata": {"Type": "work"}}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:41:51 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b551c248-6732-4cbf-ba65-216fc3f24f14 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:51 user devstack@n-api.service[72850]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 15:41:51 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:41:51 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:41:51 user devstack@n-api.service[72850]: Connection: close Apr 19 15:41:51 user devstack@n-api.service[72850]: Content-Length: 119 Apr 19 15:41:51 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:41:51 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:41:51 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:41:51 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72850]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:51 user devstack@n-api.service[72850]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72850]: Apr 19 15:41:51 user devstack@n-api.service[72850]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1962607467", "metadata": {"Type": "work"}}} Apr 19 15:41:51 user devstack@n-api.service[72850]: method: Apr 19 15:41:51 user devstack@n-api.service[72850]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72850]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1962607467', 'metadata': {'Type': 'work'}}}} Apr 19 15:41:51 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise error Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi '' Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 15:41:51 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b551c248-6732-4cbf-ba65-216fc3f24f14 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:51 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-b551c248-6732-4cbf-ba65-216fc3f24f14 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016896 Apr 19 15:41:51 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 15:41:51 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4b75b7ec-6b02-41e3-b971-69472ceb37fb tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Calling method '.version_select at 0x7f11e21b1ab0>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:41:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-4b75b7ec-6b02-41e3-b971-69472ceb37fb tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] HTTP exception thrown: Volume tempest-invalid-970988088 could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4b75b7ec-6b02-41e3-b971-69472ceb37fb tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:51 user devstack@n-api.service[72849]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-970988088 HTTP/1.1 Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:41:51 user devstack@n-api.service[72849]: Connection: close Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:41:51 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:41:51 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: method: Apr 19 15:41:51 user devstack@n-api.service[72849]: exception: Volume tempest-invalid-970988088 could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: action_args: {'id': 'tempest-invalid-970988088'} Apr 19 15:41:51 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-970988088 could not be found. (HTTP 404) (Request-ID: req-0fde3fbd-1e75-4c60-a637-15ab5b804182) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-970988088 could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-970988088 could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-970988088 could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4b75b7ec-6b02-41e3-b971-69472ceb37fb tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 404 to user: Volume tempest-invalid-970988088 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-4b75b7ec-6b02-41e3-b971-69472ceb37fb tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-970988088" status: 404 len: 98 microversion: 2.1 time: 0.319269 Apr 19 15:41:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 19 15:41:51 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-970988088 => generated 98 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-9423da8b-c314-41a9-8518-4b079927d45f tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004397 Apr 19 15:41:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 19 15:41:51 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-c4717b54-b620-4152-8c2e-96c1a88aa7d2 tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006137 Apr 19 15:41:51 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 19 15:41:51 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5c05a2ea-07da-4bc1-a54d-551b717e66fe tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Calling method '.version_select at 0x7f11e1662440>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:41:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-5c05a2ea-07da-4bc1-a54d-551b717e66fe tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] HTTP exception thrown: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5c05a2ea-07da-4bc1-a54d-551b717e66fe tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:51 user devstack@n-api.service[72849]: request: DELETE /compute/v2.1/os-volumes/10deecdb-9767-442a-bb97-635e3a061f7b HTTP/1.1 Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:41:51 user devstack@n-api.service[72849]: Connection: close Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:41:51 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:41:51 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:41:51 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:41:51 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:51 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:51 user devstack@n-api.service[72849]: method: Apr 19 15:41:51 user devstack@n-api.service[72849]: exception: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: action_args: {'id': '10deecdb-9767-442a-bb97-635e3a061f7b'} Apr 19 15:41:51 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. (HTTP 404) (Request-ID: req-0f8e7f16-c7cd-4a76-9cdc-de655be57629) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. Apr 19 15:41:51 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:41:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5c05a2ea-07da-4bc1-a54d-551b717e66fe tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 404 to user: Volume 10deecdb-9767-442a-bb97-635e3a061f7b could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5c05a2ea-07da-4bc1-a54d-551b717e66fe tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/10deecdb-9767-442a-bb97-635e3a061f7b" status: 404 len: 109 microversion: 2.1 time: 0.050997 Apr 19 15:41:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:41:51 2023] DELETE /compute/v2.1/os-volumes/10deecdb-9767-442a-bb97-635e3a061f7b => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:41:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-fa66c248-e69b-45ea-b3bf-33795476d82b tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Calling method '.version_select at 0x7f11e179ef80>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:41:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-fa66c248-e69b-45ea-b3bf-33795476d82b tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] HTTP exception thrown: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. Apr 19 15:41:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-fa66c248-e69b-45ea-b3bf-33795476d82b tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Request method failure captured: Apr 19 15:41:52 user devstack@n-api.service[72851]: request: GET /compute/v2.1/os-volumes/18bc4311-3e05-40f9-95a8-3fd03d14c98e HTTP/1.1 Apr 19 15:41:52 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:41:52 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:41:52 user devstack@n-api.service[72851]: Connection: close Apr 19 15:41:52 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:41:52 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:41:52 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:41:52 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:41:52 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAu_9jbvrk4Nh6qdH8n4oLigceGjXpVbWVTSJtVV3HUvbiYOZWNGBv2CZnzfVvK9H8f-k7V90s0n0lKnMOMLztrEs0Fy6vEsYly7efc-TL8zzd1YjfDwcQ7KJjVdkE3zjMr7-bc-HhxGRSbMgBT_LWSQeu6y5bj3Qbyfgo_izss8vrA Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Project-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Project-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a50a8549ec724d88a46a087b44e627d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a50a8549ec724d88a46a087b44e627d8"}]}] Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Tenant: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Tenant-Id: a50a8549ec724d88a46a087b44e627d8 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-VolumesNegativeTest-73690210 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-User: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:52 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:41:52 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:41:52 user devstack@n-api.service[72851]: X-User-Id: 958779122f444c24bde30484ff1bd093 Apr 19 15:41:52 user devstack@n-api.service[72851]: X-User-Name: tempest-VolumesNegativeTest-73690210-project-member Apr 19 15:41:52 user devstack@n-api.service[72851]: method: Apr 19 15:41:52 user devstack@n-api.service[72851]: exception: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. Apr 19 15:41:52 user devstack@n-api.service[72851]: action_args: {'id': '18bc4311-3e05-40f9-95a8-3fd03d14c98e'} Apr 19 15:41:52 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. (HTTP 404) (Request-ID: req-8f61870c-5b80-432f-8ed8-a455bce91177) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. Apr 19 15:41:52 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:41:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-fa66c248-e69b-45ea-b3bf-33795476d82b tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] Returning 404 to user: Volume 18bc4311-3e05-40f9-95a8-3fd03d14c98e could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:41:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-fa66c248-e69b-45ea-b3bf-33795476d82b tempest-VolumesNegativeTest-73690210 tempest-VolumesNegativeTest-73690210-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18bc4311-3e05-40f9-95a8-3fd03d14c98e" status: 404 len: 109 microversion: 2.1 time: 0.175941 Apr 19 15:41:52 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:41:51 2023] GET /compute/v2.1/os-volumes/18bc4311-3e05-40f9-95a8-3fd03d14c98e => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:42:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-309524834", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "c0c90add-4609-460a-809f-489f999700f0"}]}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:09 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] validate_networks() for [('c0c90add-4609-460a-809f-489f999700f0', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Getting quotas for project cba4752f63044041a25605f636eb3d18. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Getting quotas for user 7d86531c4aed432fbca7511b49a07158 and project cba4752f63044041a25605f636eb3d18. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:11 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:11 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-4a431e38-869f-4ebc-89fa-0a9745457add tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.968739 Apr 19 15:42:11 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:42:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:42:11 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d959d811-c61d-49a1-9b98-292a1f1c961e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:11 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d959d811-c61d-49a1-9b98-292a1f1c961e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:11 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-d959d811-c61d-49a1-9b98-292a1f1c961e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d86531c4aed432fbca7511b49a07158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4752f63044041a25605f636eb3d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:11 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d959d811-c61d-49a1-9b98-292a1f1c961e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80" status: 200 len: 1208 microversion: 2.1 time: 0.458876 Apr 19 15:42:11 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:42:11 2023] GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 => generated 1208 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:42:15 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-706950439", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "32c3e048-3dee-4ebc-b028-ef87b79a1668"}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:15 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] validate_networks() for [('32c3e048-3dee-4ebc-b028-ef87b79a1668', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:16 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5a212384-74e5-4374-ad32-7960ec29b6cb tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Action: 'create', calling method: .version_select at 0x7f11e1663400>, body: {"keypair": {"name": "tempest-keypair-2086142111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5GtvjT8cFL2DdAqPgnakYyz2kSBWlLS4AD5lRfcyLcsKX/qu7+mhfEg+Jg7KUxqz5u4CC5z7krr0BgWx8coy4AvdYkazQ6rAihxeIt7FNcld4Exa1s3NZ/fNgAe9JqZQ=="}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:17 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-5a212384-74e5-4374-ad32-7960ec29b6cb tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for project c42f3c3da3f945a1a946db703408fd69. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:17 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-5a212384-74e5-4374-ad32-7960ec29b6cb tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for user d00ada35fa344f1cb23f3b6470a87d99 and project c42f3c3da3f945a1a946db703408fd69. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:17 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-0fc5031c-02fd-4d11-b9ab-d570189a311d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Action: 'create', calling method: .version_select at 0x7f11e16c08b0>, body: {"keypair": {"name": "tempest-keypair-601838696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFZcl9s4v+U/SABRzS4SM/IksXo3iudyDG4pFgJWwyf5u+j4YO5s9iejIgi2DezLGX99PhdmS9DosbVbPjoSvK3bUsOaG+CRVv0dt69hP265MSseROuvU7jYL4DsJ6KcQ=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:17 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-0fc5031c-02fd-4d11-b9ab-d570189a311d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Getting quotas for project c7fceb0e89f74207b2f4ec4e4bf39e03. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:17 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-0fc5031c-02fd-4d11-b9ab-d570189a311d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Getting quotas for user f90cfd0897fe49a6a04e8c1a26cb58ff and project c7fceb0e89f74207b2f4ec4e4bf39e03. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5a212384-74e5-4374-ad32-7960ec29b6cb tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.246673 Apr 19 15:42:17 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 19/56] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 15:42:16 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:42:17 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-0fc5031c-02fd-4d11-b9ab-d570189a311d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295629 Apr 19 15:42:17 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:42:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for user 1f9882d12b0549c7ba8d6f3fe436e86c and project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:17 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:18 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-086043c3-39d3-4336-ac32-46f435f4bd55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.725342 Apr 19 15:42:18 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 20/58] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:42:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:42:18 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:18 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:18 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:18 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:18 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:18 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1007b3db-fda9-48c7-85ed-d2ed923e83a3 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 200 len: 1394 microversion: 2.87 time: 0.153355 Apr 19 15:42:18 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:42:18 2023] GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 1394 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Creating event network-changed:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c92e8c9-2f4d-49b3-84ab-64de203f1eda req-3919bfc9-01c4-4447-8f8b-ce89f7eaa9ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=72850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:20 user devstack@n-api.service[72850]: INFO nova.compute.rpcapi [None req-6943e818-ff22-485a-affa-a3475246360a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 15:42:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-6943e818-ff22-485a-affa-a3475246360a None None] Releasing lock "compute-rpcapi-router" {{(pid=72850) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 15:42:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-6943e818-ff22-485a-affa-a3475246360a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304695 Apr 19 15:42:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:22 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-300841027", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8a84383a-b04d-43d2-b8fa-475db387d9f3"}], "security_groups": [{"name": "tempest-securitygroup--13631705"}], "key_name": "tempest-keypair-2086142111", "user_data": "}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:23 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] validate_networks() for [('8a84383a-b04d-43d2-b8fa-475db387d9f3', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:24 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-877193417", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9f403518-c429-46fd-8756-46e59d44d1a4"}], "security_groups": [{"name": "tempest-securitygroup--1371270259"}], "key_name": "tempest-keypair-601838696", "user_data": "}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:24 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] validate_networks() for [('9f403518-c429-46fd-8756-46e59d44d1a4', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for project c42f3c3da3f945a1a946db703408fd69. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for user d00ada35fa344f1cb23f3b6470a87d99 and project c42f3c3da3f945a1a946db703408fd69. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:24 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:24 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-aafcb2cd-6e55-4a1e-a033-fca5c433b483 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.20 time: 2.201168 Apr 19 15:42:24 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 21/61] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:42:22 2023] POST /compute/v2.1/servers => generated 398 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:42:24 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:24 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:25 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:25 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:25 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:25 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-4e4ef3e4-db1f-4c1d-ae77-af1abe14a13e tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 200 len: 1275 microversion: 2.20 time: 0.129458 Apr 19 15:42:25 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:42:24 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:25 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Creating event network-changed:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72851) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-71a2f895-473a-49be-aa7e-fcc9c383bb11 req-8ad3fee2-7f0f-4113-b0e5-932f40f07bac service nova] Acquired lock "compute-rpcapi-router" {{(pid=72851) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:25 user devstack@n-api.service[72851]: INFO nova.compute.rpcapi [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 15:42:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] Releasing lock "compute-rpcapi-router" {{(pid=72851) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 15:42:25 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-9386ad73-6d64-47a4-8985-5ed64765bffc None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226467 Apr 19 15:42:25 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:26 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-48dac0b0-d7d0-418c-9983-5efe31c6e848 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Action: 'create', calling method: .version_select at 0x7f11e0d3ac20>, body: {"keypair": {"name": "tempest-keypair-1817890597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYz4tg5Y7sSuXMvAfRcWu+kqRKH48wkimJ3sARQ07NPmx2e2WVAlBIjERG64tXdMsWmVkFjExZgt+OiGsCXat/JpNwbYJGQs+p3F/QUxPvBsISSCSi3MxAo8gQf69DTyA=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:26 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-48dac0b0-d7d0-418c-9983-5efe31c6e848 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for project c81ec3d570254ba98de839dff3a4e38d. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:26 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-48dac0b0-d7d0-418c-9983-5efe31c6e848 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for user ea2dcb51753d4099805e8589c93b8143 and project c81ec3d570254ba98de839dff3a4e38d. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-48dac0b0-d7d0-418c-9983-5efe31c6e848 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169107 Apr 19 15:42:26 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:42:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Getting quotas for project c7fceb0e89f74207b2f4ec4e4bf39e03. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Getting quotas for user f90cfd0897fe49a6a04e8c1a26cb58ff and project c7fceb0e89f74207b2f4ec4e4bf39e03. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:27 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:27 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d9bc1f08-d72a-49f1-b010-b128929c8b85 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.068434 Apr 19 15:42:27 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:42:24 2023] POST /compute/v2.1/servers => generated 407 bytes in 3070 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:42:27 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-b063a1c1-0595-48c7-9188-1106539185ec tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:27 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-b063a1c1-0595-48c7-9188-1106539185ec tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:27 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-b063a1c1-0595-48c7-9188-1106539185ec tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:27 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-b063a1c1-0595-48c7-9188-1106539185ec tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1231 microversion: 2.1 time: 0.142519 Apr 19 15:42:27 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:42:27 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1231 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:42:28 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "name": "network-vif-plugged", "status": "completed", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:28 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] Creating event network-vif-plugged:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:42:28 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-01c13286-1272-45dc-bab9-31d022a947e4 req-3d271b22-48f8-4fec-828c-87539eb50099 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063261 Apr 19 15:42:28 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "name": "network-vif-plugged", "status": "completed", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:30 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "name": "network-vif-plugged", "status": "completed", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:30 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] Creating event network-vif-plugged:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:42:30 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-f9a82f32-c16e-4f2b-b57e-2949184684f5 req-5a29b2a7-0b97-4ba8-a658-32e1e3b0ebe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039564 Apr 19 15:42:30 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:30 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Creating event network-vif-plugged:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72849) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-abc792db-830f-40ee-87cd-ad610f652d91 req-58818f94-1bf1-4dcf-bc39-51334ae48f83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72849) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:30 user devstack@n-api.service[72849]: INFO nova.compute.rpcapi [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 15:42:30 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=72849) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 15:42:30 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-99fa417b-945f-4c71-b6ed-6dcff81225d4 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215130 Apr 19 15:42:30 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 22/69] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:32 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:32 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}, {"server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "name": "network-vif-plugged", "status": "completed", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:32 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Creating event network-changed:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:42:32 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] Creating event network-vif-plugged:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:42:33 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-ade95d14-e9b2-4988-9fd2-1a6396e45da7 req-6dce00b1-06a4-4c3e-a4dd-1f8db8d0fe92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089083 Apr 19 15:42:33 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:34 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:34 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:34 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:34 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:34 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] Creating event network-changed:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:42:34 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-b77e2bc7-7512-4a07-a860-cda71948a5f8 req-d7e887e9-f5d7-4b03-8e69-3ba32c8667d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061659 Apr 19 15:42:34 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:35 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1579453739", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "2120248e-0535-4c4b-9005-45e5c51f68d9"}], "security_groups": [{"name": "tempest-securitygroup--1469013667"}], "key_name": "tempest-keypair-1817890597", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:35 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] validate_networks() for [('2120248e-0535-4c4b-9005-45e5c51f68d9', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:37 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=16 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:37 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "name": "network-vif-plugged", "status": "completed", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:37 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] Creating event network-vif-plugged:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:42:37 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-b59031fb-56a6-4792-a58a-03e038b9fd5a req-ec1b0a7c-cbff-463c-8a30-b91587a3c7f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117434 Apr 19 15:42:37 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:37 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=14 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "name": "network-vif-plugged", "status": "completed", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=14 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:38 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] Creating event network-vif-plugged:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:42:38 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-0e28e08d-7280-4f2e-bbad-cfb375d321e1 req-61a1d507-20d2-4200-97d8-f6f05bc1cf29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038052 Apr 19 15:42:38 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for project c81ec3d570254ba98de839dff3a4e38d. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for user ea2dcb51753d4099805e8589c93b8143 and project c81ec3d570254ba98de839dff3a4e38d. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:38 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:38 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-2ac9e848-2c62-410e-8df7-1dab74e0429e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.137901 Apr 19 15:42:38 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 23/74] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:42:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:42:38 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-569656df-f52a-41c9-8edf-212e07d12438 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:38 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-569656df-f52a-41c9-8edf-212e07d12438 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:38 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-569656df-f52a-41c9-8edf-212e07d12438 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:38 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-569656df-f52a-41c9-8edf-212e07d12438 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262" status: 200 len: 1236 microversion: 2.1 time: 0.153285 Apr 19 15:42:38 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 26/75] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:42:38 2023] GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 => generated 1236 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:42:39 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "name": "network-vif-plugged", "status": "completed", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:39 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] Creating event network-vif-plugged:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:42:39 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-68053a58-78ca-40e3-95f9-ae594ae35769 req-04641a67-cba2-4d08-85b1-f0d9d4243199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050570 Apr 19 15:42:39 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:40 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "name": "network-vif-plugged", "status": "completed", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] Creating event network-vif-plugged:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:42:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-0f9e4184-4b4c-4ea2-af2b-263015f3870a req-dcb515ee-13cf-4749-897b-de78ff21507b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069709 Apr 19 15:42:40 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 24/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] Creating event network-changed:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:42:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-2801322b-8bf1-438f-934e-164b3e5cd6a3 req-d7b3e8f5-0825-471b-9ca5-b9c12b6dd72c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046979 Apr 19 15:42:44 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 28/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:44 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e1f7cd2f-7046-4f2d-89d2-bff331e0f99b tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Action: 'create', calling method: .version_select at 0x7f11e0d3b880>, body: {"keypair": {"name": "tempest-keypair-1240069358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPJKhaWbJ7tU9ugQ65kXcxfvVKLByC5cIEVq88G78pJCBNsvEPdexE1RDohOffO+tsYGXJC0MayGf8PPstNU5f7agK1NktJlWt36pJREvyZpPvix/WeH5z2mKbUeup4jQ=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:44 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=5 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:44 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e1f7cd2f-7046-4f2d-89d2-bff331e0f99b tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Getting quotas for project bb3cf6df3f3c4b77a484366eec229734. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:44 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e1f7cd2f-7046-4f2d-89d2-bff331e0f99b tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Getting quotas for user 6f0a32c0350843bd8344a46638f58c86 and project bb3cf6df3f3c4b77a484366eec229734. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e1f7cd2f-7046-4f2d-89d2-bff331e0f99b tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308493 Apr 19 15:42:44 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:42:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:47 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "name": "network-vif-plugged", "status": "completed", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:47 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:47 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:47 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:47 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] Creating event network-vif-plugged:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:42:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-fa2020a1-0ad6-4a32-8b3b-620091e16142 req-d0de0fef-2ed3-4cdc-b1d5-b042a728d435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117651 Apr 19 15:42:47 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 25/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:49 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-569035544", "imageRef": "e6e62e91-f4c1-445b-8854-8baf42832c11", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3cba41ac-db09-4596-9aeb-c92c6e8a1e9e"}], "security_groups": [{"name": "tempest-securitygroup--90519826"}], "key_name": "tempest-keypair-1240069358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:49 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:49 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] validate_networks() for [('3cba41ac-db09-4596-9aeb-c92c6e8a1e9e', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:42:49 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "name": "network-vif-plugged", "status": "completed", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:50 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=12 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] Creating event network-vif-plugged:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:42:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-52e82468-4af7-4453-84ff-ae386ddce13c req-9fd08bf9-a769-4b98-9aed-2d416dd95b76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059048 Apr 19 15:42:50 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=19 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Getting quotas for project bb3cf6df3f3c4b77a484366eec229734. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Getting quotas for user 6f0a32c0350843bd8344a46638f58c86 and project bb3cf6df3f3c4b77a484366eec229734. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:42:51 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6e62e91-f4c1-445b-8854-8baf42832c11',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:42:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-7e602bf7-8580-4d4b-952b-af99f8d924c4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.009225 Apr 19 15:42:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 29/82] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:42:49 2023] POST /compute/v2.1/servers => generated 402 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:42:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-b230c526-e86e-4b01-94cb-a5e737121e7e tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:42:51 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-b230c526-e86e-4b01-94cb-a5e737121e7e tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:42:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:51 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-b230c526-e86e-4b01-94cb-a5e737121e7e tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0a32c0350843bd8344a46638f58c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb3cf6df3f3c4b77a484366eec229734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:42:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-b230c526-e86e-4b01-94cb-a5e737121e7e tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 200 len: 1239 microversion: 2.1 time: 0.114435 Apr 19 15:42:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 26/83] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:42:51 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:42:57 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:42:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:42:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:42:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:42:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:42:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] Creating event network-changed:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:42:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-e0da2984-d903-42ed-b411-84c1e33cad6d req-8734f57e-4f4a-44c6-901e-8079b704194f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 Apr 19 15:42:57 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:01 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "name": "network-vif-plugged", "status": "completed", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:01 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=12 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:01 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:01 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:01 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:01 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] Creating event network-vif-plugged:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:43:01 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-d1a01a60-85cd-42b4-a454-bbfafe0cca2d req-def28f56-5fbb-491b-b4e4-b0a62bf275cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045829 Apr 19 15:43:01 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 27/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:01 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-f699a309-1d7e-4718-a494-0aad26103e9e tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] Action: 'create', calling method: .version_select at 0x7f11e15fa200>, body: {"keypair": {"name": "tempest-TestShelveInstance-257067462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtcxf6zIk8V+M9PpLHbD2PoJ8mocFZM65XFu+KW+gE48w9kCyYas5zBVcH3GWalkGsPSWudOeTxaPqiw120V2OvNYszbWtZWisf0EkM+smPOAZkCg03wpt/b/ckESzT+A=="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:01 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-f699a309-1d7e-4718-a494-0aad26103e9e tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] Getting quotas for project 9d23bf5462294c19ad496d1241fc29f7. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:43:01 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-f699a309-1d7e-4718-a494-0aad26103e9e tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] Getting quotas for user e2e36dfdeb714959982102a33b5151a2 and project 9d23bf5462294c19ad496d1241fc29f7. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:43:01 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:01 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:01 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-f699a309-1d7e-4718-a494-0aad26103e9e tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.365674 Apr 19 15:43:01 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:43:00 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:02 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d86531c4aed432fbca7511b49a07158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4752f63044041a25605f636eb3d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:02 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-81a13df1-2e2e-4675-a6ba-78ee13d15b68 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80" status: 200 len: 1490 microversion: 2.1 time: 0.479769 Apr 19 15:43:02 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:01 2023] GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 => generated 1490 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:43:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:03 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "name": "network-vif-plugged", "status": "completed", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:03 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] Creating event network-vif-plugged:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:43:03 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-a5238e9b-9fad-4e36-be49-3e8279fdbfc5 req-eeb4a07e-bfca-4709-82be-8461ea374092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038722 Apr 19 15:43:03 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:05 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-6ada0e83-c5f1-4e3f-a32a-c274faf61adc tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] Calling method '.version_select at 0x7f11e15f9750>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-6ada0e83-c5f1-4e3f-a32a-c274faf61adc tempest-TestShelveInstance-1904983951 tempest-TestShelveInstance-1904983951-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-257067462" status: 202 len: 0 microversion: 2.1 time: 0.024024 Apr 19 15:43:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 19 15:43:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-257067462 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:43:06 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-549593509", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:06 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] validate_networks() for [('a53fed79-6cb6-4cb4-af53-22aed8f17336', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Getting quotas for project 792266f480534fb79345374f09042875. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Getting quotas for user ecb1979bbcb246b9b7b3c73f67af0b64 and project 792266f480534fb79345374f09042875. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:43:07 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:43:07 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-fcaa9ab0-ec25-48e2-a0f3-09634dc57f0e tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.826867 Apr 19 15:43:07 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:43:05 2023] POST /compute/v2.1/servers => generated 381 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:43:07 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-894e544c-f317-4b81-9b18-f7c71420c1ee tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:07 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-894e544c-f317-4b81-9b18-f7c71420c1ee tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:07 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-894e544c-f317-4b81-9b18-f7c71420c1ee tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:07 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-894e544c-f317-4b81-9b18-f7c71420c1ee tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7" status: 200 len: 1215 microversion: 2.1 time: 0.155310 Apr 19 15:43:07 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 29/91] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:07 2023] GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:43:08 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2049964564", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:08 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] validate_networks() for [('a53fed79-6cb6-4cb4-af53-22aed8f17336', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:08 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:08 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-537b21e1-f3f5-4c25-9369-8276e504c16b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 200 len: 1690 microversion: 2.87 time: 0.473231 Apr 19 15:43:08 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 32/92] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:43:08 2023] GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 1690 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Getting quotas for project 792266f480534fb79345374f09042875. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Getting quotas for user ecb1979bbcb246b9b7b3c73f67af0b64 and project 792266f480534fb79345374f09042875. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:43:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:43:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-286fc8cd-cf2c-4e4e-9d1e-073bfef4b736 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.544167 Apr 19 15:43:09 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 32/93] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:43:08 2023] POST /compute/v2.1/servers => generated 381 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:43:09 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-35de8c3a-893b-49e8-93d8-1cb844e9fac0 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:09 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-35de8c3a-893b-49e8-93d8-1cb844e9fac0 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:10 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-35de8c3a-893b-49e8-93d8-1cb844e9fac0 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-35de8c3a-893b-49e8-93d8-1cb844e9fac0 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 200 len: 1216 microversion: 2.1 time: 0.591856 Apr 19 15:43:10 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:09 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 1216 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:43:11 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1155260006", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "7004f7e3-1c4f-4d0e-b868-729c2861bae1"}]}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:11 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] validate_networks() for [('7004f7e3-1c4f-4d0e-b868-729c2861bae1', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:43:12 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:12 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:12 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:12 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:43:12 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] Creating event network-changed:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:12 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-eb79d036-3dc0-42b0-8fe5-687cfe42ce9b req-c67b0999-3aae-449e-8f01-87d29ae69114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035432 Apr 19 15:43:12 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Getting quotas for project 4d7a7d854e5047be8182fcc02f68c125. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Getting quotas for user f4f54b80641e48dfbc83ba21c1decb9c and project 4d7a7d854e5047be8182fcc02f68c125. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:43:12 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:43:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-8967000b-8d44-4882-ba99-24b613afd636 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.241907 Apr 19 15:43:12 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 33/96] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:43:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:43:12 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5193b3b0-d734-43d5-9ea8-ff49239c2799 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:12 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-5193b3b0-d734-43d5-9ea8-ff49239c2799 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:12 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-5193b3b0-d734-43d5-9ea8-ff49239c2799 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:12 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5193b3b0-d734-43d5-9ea8-ff49239c2799 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1211 microversion: 2.1 time: 0.228584 Apr 19 15:43:12 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 31/97] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:12 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1211 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:43:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] Creating event network-changed:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:43:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-4f93f297-3919-4f8c-bcd0-0a47881156dc req-44dfc26b-68e2-4482-bb84-1f0e2dac1228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 Apr 19 15:43:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=7 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:15 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:15 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f6f843fc-9617-4fb6-980c-021782b3981c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 200 len: 1585 microversion: 2.20 time: 0.346503 Apr 19 15:43:15 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 34/99] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:43:15 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 1585 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 15:43:15 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:15 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] Creating event network-changed:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:43:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-1c1ed206-5074-45a2-a8b4-558ed0b2e3d4 req-c307c45e-e7b8-4468-a29c-5e00fa967edb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043324 Apr 19 15:43:15 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:17 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "name": "network-vif-plugged", "status": "completed", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}, {"server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "name": "network-vif-plugged", "status": "completed", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Creating event network-vif-plugged:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:43:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] Creating event network-vif-plugged:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:43:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-84bcd44a-0884-4fc8-aa47-16746c735604 req-eed4bad6-11f9-4034-9af8-70105d9667f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036558 Apr 19 15:43:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:17 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:18 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-745e1a5b-b6ba-48e4-a3f0-6ff72a5badf9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1538 microversion: 2.1 time: 0.255364 Apr 19 15:43:18 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:17 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1538 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:43:18 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "name": "network-vif-plugged", "status": "completed", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:18 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=24 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:18 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] Creating event network-vif-plugged:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:43:18 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-1f2352ff-d726-4cc0-8e6d-0941d7b7fc1d req-b9ae4813-3b83-4f86-936a-4fecff3de4e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033892 Apr 19 15:43:18 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=16 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}, {"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:43:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:43:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-cfdd6360-1313-4002-b3d2-4cb9fb187ebb req-33531ca2-003a-49ac-b348-6ca62bffad18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077307 Apr 19 15:43:19 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 36/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "name": "network-vif-plugged", "status": "completed", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:43:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:20 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=33 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] Creating event network-vif-plugged:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:43:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-f887fa8f-2bfb-4b09-969c-d1b5c11d8f4b req-af98442c-67b0-47ac-8454-80f52edab517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034963 Apr 19 15:43:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:43:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:29 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:29 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1c033ef5-5627-4fda-8f87-77867fb7af3a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262" status: 200 len: 1546 microversion: 2.1 time: 0.296304 Apr 19 15:43:29 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 34/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:28 2023] GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=10 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:43:41 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0a32c0350843bd8344a46638f58c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb3cf6df3f3c4b77a484366eec229734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:43:41 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-3c7c340f-df7e-4eec-bc73-df1649830fa8 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 200 len: 1547 microversion: 2.1 time: 0.294069 Apr 19 15:43:41 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:43:41 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 1547 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=12 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=5 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:00 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:00 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f43f741a-d918-4937-ab01-62c1505496b7 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 200 len: 1504 microversion: 2.1 time: 0.320762 Apr 19 15:44:00 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:00 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:02 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:03 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:03 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-539b9e7b-7fd5-4c07-b893-636105fbb5b0 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1495 microversion: 2.1 time: 0.248854 Apr 19 15:44:03 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 35/109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:02 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1495 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=3 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:04 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:44:04 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-0e1e0199-b3a6-4a8c-bcdc-2f5d0802d689 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80" status: 204 len: 0 microversion: 2.1 time: 0.396218 Apr 19 15:44:04 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:44:04 2023] DELETE /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:04 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d86531c4aed432fbca7511b49a07158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba4752f63044041a25605f636eb3d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f0eb6297-c17b-457d-ad01-509d07b76845 tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80" status: 200 len: 1496 microversion: 2.1 time: 0.274457 Apr 19 15:44:04 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:04 2023] GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 => generated 1496 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:04 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "name": "network-vif-unplugged", "status": "completed", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:04 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] Creating event network-vif-unplugged:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:44:04 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-dbff13a2-dde4-4c7f-8465-81f6b6d6a8fe req-05dce6f2-225a-4914-9104-f82e6b380af0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052182 Apr 19 15:44:04 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 36/112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:05 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "name": "network-vif-deleted", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] Creating event network-vif-deleted:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:44:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-7c2ae2f7-6e98-43fd-9436-f8c9912c42d1 req-a3b56051-344d-4d8c-8158-c9a110389e06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033260 Apr 19 15:44:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:06 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5136965b-1d29-47d4-ae99-33b31a668b80", "name": "network-vif-plugged", "status": "completed", "tag": "1e007a8e-97d2-4c22-973c-4e74ba8a3e8a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:06 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] Creating event network-vif-plugged:1e007a8e-97d2-4c22-973c-4e74ba8a3e8a for instance 5136965b-1d29-47d4-ae99-33b31a668b80 on user Apr 19 15:44:06 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-fbe778ac-ac50-44ff-8f55-2db15bc99eec req-c2871467-1d27-4ded-9b9e-455f41e612ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030457 Apr 19 15:44:06 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1739317203"}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5a468ab6-7423-4d6b-9f12-49ded72f1b32 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72/action" status: 202 len: 52 microversion: 2.87 time: 1.387698 Apr 19 15:44:10 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 37/115] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 15:44:08 2023] POST /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72/action => generated 52 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:15 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:15 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-2702b0ff-0db2-43b8-b84d-dec9f4915398 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 200 len: 1690 microversion: 2.87 time: 0.289283 Apr 19 15:44:15 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 40/116] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:44:15 2023] GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:44:15 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e06ccd5c-11fc-4bbe-8ea6-f275e6702d51 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.200870 Apr 19 15:44:15 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 40/117] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 15:44:15 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89/os-interface => generated 282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:44:16 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:16 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] Creating event network-changed:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:44:16 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-133d8ed1-82f7-489b-aa4b-27ab7e3cc746 req-b31073bc-02a7-4164-952c-44002f1c9bef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Apr 19 15:44:16 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:16 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-1568316c-cbbe-473a-8082-f601b859dde7 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89/ips" status: 200 len: 110 microversion: 2.20 time: 0.047262 Apr 19 15:44:16 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 41/119] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 15:44:16 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89/ips => generated 110 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:44:18 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-5124f74b-3c2b-47c7-aee5-fe785de68cf6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.334292 Apr 19 15:44:18 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 41/120] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:44:18 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243/os-interface => generated 283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:18 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-bd5b4789-4c2a-4aee-a38c-e129747ce92d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 204 len: 0 microversion: 2.20 time: 0.228085 Apr 19 15:44:18 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 39/121] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:44:18 2023] DELETE /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "name": "network-vif-unplugged", "status": "completed", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:18 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] Creating event network-vif-unplugged:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:44:18 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-ae75e598-e543-4567-b20c-19b0d006ec9a req-f34324f7-0992-48ff-970c-fb27a08ac7bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037668 Apr 19 15:44:18 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:19 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:19 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:19 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-2bb29c85-c606-460a-b15c-77d230a27ef0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 200 len: 1709 microversion: 2.20 time: 0.686335 Apr 19 15:44:19 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 42/123] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:44:18 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 1709 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] Creating event network-changed:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:44:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-4784a42c-f105-4a22-9d4f-342c4e48ecea req-924e7e4b-aa5c-4292-8f98-b4f0b2c1c053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047416 Apr 19 15:44:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f8287bf2-a6f6-40ed-be62-cb749dde4cf7 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1538 microversion: 2.1 time: 0.386643 Apr 19 15:44:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 43/125] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:20 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1538 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "name": "network-vif-deleted", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] Creating event network-vif-deleted:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:44:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-e35e73f6-10da-45cc-ad44-1f78549058ab req-aad7d514-5e05-4529-8dc3-37c896697702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 Apr 19 15:44:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:20 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:20 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-882cedd5-5b06-4a75-9951-1e7ced4a6970 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1538 microversion: 2.1 time: 0.266951 Apr 19 15:44:20 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:20 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1538 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709ad03-162e-408f-af2b-072b5c041a89", "name": "network-vif-plugged", "status": "completed", "tag": "a3138fe0-55b3-4652-b8a7-c713b309730a"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] Creating event network-vif-plugged:a3138fe0-55b3-4652-b8a7-c713b309730a for instance c709ad03-162e-408f-af2b-072b5c041a89 on user Apr 19 15:44:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-61af0725-a3e2-40e5-b2b4-74b8c8ecab6a req-0472e210-ff4d-4347-bd80-55f4a6f75057 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Apr 19 15:44:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:29 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-c8ce9156-a3f2-438b-8841-2fbd1bc6a19a tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.167591 Apr 19 15:44:29 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 42/129] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:44:29 2023] GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262/os-interface => generated 282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:30 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:30 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:30 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] Creating event network-changed:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:44:30 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-a477b383-3ec3-4b1c-8bea-a05dc2da3881 req-bba96afc-1408-4a63-911a-eeea57d125e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032719 Apr 19 15:44:30 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:31 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=16 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:31 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=33 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:31 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1445375137", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "2120248e-0535-4c4b-9005-45e5c51f68d9"}]}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:31 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] validate_networks() for [('2120248e-0535-4c4b-9005-45e5c51f68d9', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for project c81ec3d570254ba98de839dff3a4e38d. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Getting quotas for user ea2dcb51753d4099805e8589c93b8143 and project c81ec3d570254ba98de839dff3a4e38d. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:44:32 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:44:32 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-962d7950-c007-4fa7-b669-0496e855673b tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.629925 Apr 19 15:44:32 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 45/131] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:44:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:44:32 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-73886d3f-8a43-4fea-8150-663229884e5e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:32 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-73886d3f-8a43-4fea-8150-663229884e5e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:32 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-73886d3f-8a43-4fea-8150-663229884e5e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:32 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-73886d3f-8a43-4fea-8150-663229884e5e tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc" status: 200 len: 1212 microversion: 2.1 time: 0.066304 Apr 19 15:44:32 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 43/132] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:32 2023] GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:35 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:35 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] Creating event network-changed:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:44:35 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-a072e191-19d4-454b-908c-4960ef3718fa req-17161170-9d9f-4ce9-88ea-fa59168d9e5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Apr 19 15:44:35 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:37 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "name": "network-vif-plugged", "status": "completed", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:37 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:37 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] Creating event network-vif-plugged:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:44:37 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-08135009-4534-46ca-8ecf-d4a299006899 req-ff15d802-0318-48c7-9b20-ecb3259f309c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031534 Apr 19 15:44:37 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "name": "network-vif-plugged", "status": "completed", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:39 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:39 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] Creating event network-vif-plugged:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:44:39 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-fedcbb43-fb6d-4082-bb1e-759762eafeae req-04dbc02b-19ee-49b4-8bd9-2e052133db97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048675 Apr 19 15:44:39 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:42 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-7887007e-3b14-4792-a71e-53b330fa0540 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169282 Apr 19 15:44:42 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 46/136] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:44:41 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:43 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] Creating event network-changed:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:44:43 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-3f00d075-fb5b-4d91-be9a-6219ae0cc742 req-09ed6898-a92e-4650-9593-3fe4a26e7324 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037791 Apr 19 15:44:43 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:44 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:44:44 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a5778bf1-3df1-4e6e-8a82-319283ae3a56 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 204 len: 0 microversion: 2.1 time: 0.137388 Apr 19 15:44:44 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 45/138] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:44:44 2023] DELETE /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:44 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "name": "network-vif-unplugged", "status": "completed", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] Creating event network-vif-unplugged:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:44:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-4e01b38b-3588-4912-813f-c9fba964d6de req-277a3d71-57af-4153-bdb4-77f1b89689b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032814 Apr 19 15:44:44 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:44:45 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0a32c0350843bd8344a46638f58c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb3cf6df3f3c4b77a484366eec229734', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:44:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-28992dec-e2bd-49a0-acbe-3234432f03f4 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 200 len: 1671 microversion: 2.1 time: 0.742187 Apr 19 15:44:45 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 47/140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:44 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 1671 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:44:46 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "name": "network-vif-plugged", "status": "completed", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}, {"server_uuid": "9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f", "name": "network-vif-deleted", "tag": "f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:44:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Creating event network-vif-plugged:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:44:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] Creating event network-vif-deleted:f1c07e62-d5d9-4c2c-857d-bd72ac7f53ff for instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f on user Apr 19 15:44:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-7a39f213-fa4b-49c3-b895-5713b4e9ecf8 req-dbfae139-1e20-48f5-929a-0aaa41a36cf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031761 Apr 19 15:44:47 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] [instance: 5136965b-1d29-47d4-ae99-33b31a668b80] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:44:54 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] HTTP exception thrown: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Request method failure captured: Apr 19 15:44:54 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 HTTP/1.1 Apr 19 15:44:54 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:44:54 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:44:54 user devstack@n-api.service[72850]: Connection: close Apr 19 15:44:54 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:44:54 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:44:54 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:44:54 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:44:54 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvR3jE_Fkq6LBViZ8uI7oVoF7CPlwAkj2qDeOUjwB4_fkqGbywp7RL-tZFUBCDqrvQkP62ZptlYfcVojvjQ6zxfrA-fVt_6pzX2Cj2Sz2VIXSnDH0ej-vB1xRGGkOdTfUo0iaeGiGDz-cJxTj5RGvTDTmwApdzzQT6SaxXeb2G3ekQ Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Project-Id: cba4752f63044041a25605f636eb3d18 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Project-Name: tempest-DeleteServersTestJSON-1537455612 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cba4752f63044041a25605f636eb3d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cba4752f63044041a25605f636eb3d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cba4752f63044041a25605f636eb3d18"}]}] Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Tenant: tempest-DeleteServersTestJSON-1537455612 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Tenant-Id: cba4752f63044041a25605f636eb3d18 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1537455612 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-User: tempest-DeleteServersTestJSON-1537455612-project-member Apr 19 15:44:54 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:44:54 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:44:54 user devstack@n-api.service[72850]: X-User-Id: 7d86531c4aed432fbca7511b49a07158 Apr 19 15:44:54 user devstack@n-api.service[72850]: X-User-Name: tempest-DeleteServersTestJSON-1537455612-project-member Apr 19 15:44:54 user devstack@n-api.service[72850]: method: > Apr 19 15:44:54 user devstack@n-api.service[72850]: exception: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. Apr 19 15:44:54 user devstack@n-api.service[72850]: action_args: {'id': '5136965b-1d29-47d4-ae99-33b31a668b80'} Apr 19 15:44:54 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. Apr 19 15:44:54 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:44:54 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] Returning 404 to user: Instance 5136965b-1d29-47d4-ae99-33b31a668b80 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:44:54 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-1632e285-237d-46e7-a93e-e1a3f151782e tempest-DeleteServersTestJSON-1537455612 tempest-DeleteServersTestJSON-1537455612-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80" status: 404 len: 111 microversion: 2.1 time: 0.040221 Apr 19 15:44:54 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:44:54 2023] GET /compute/v2.1/servers/5136965b-1d29-47d4-ae99-33b31a668b80 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=5 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=11 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:00 user devstack@n-api.service[72851]: DEBUG nova.objects.instance [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lazy-loading 'flavor' on Instance uuid aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 {{(pid=72851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 15:45:00 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8c86e5b9-eced-4706-bca3-83eb572fdd1f tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1/action" status: 200 len: 32 microversion: 2.1 time: 0.153423 Apr 19 15:45:00 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 48/143] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 15:45:00 2023] POST /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:01 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:01 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-60772abd-f54e-45bf-9188-4ee51ea7c624 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 200 len: 1510 microversion: 2.1 time: 0.245092 Apr 19 15:45:01 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:00 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:01 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-unplugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:01 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:01 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] Creating event network-vif-unplugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:45:01 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-a9c533af-2d4a-4dbe-b64d-d5b946dc199d req-3d488bd2-98a1-4070-a63f-72ea162f9126 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039418 Apr 19 15:45:01 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 50/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:45:03 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1414669656", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "7004f7e3-1c4f-4d0e-b868-729c2861bae1"}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:03 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] validate_networks() for [('7004f7e3-1c4f-4d0e-b868-729c2861bae1', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:45:03 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:03 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:45:03 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-1532d3e8-4e04-4614-a763-8cb68e613407 req-a12d18a4-7dce-4ee1-9848-7f6940a87821 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Apr 19 15:45:03 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Getting quotas for project 4d7a7d854e5047be8182fcc02f68c125. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Getting quotas for user f4f54b80641e48dfbc83ba21c1decb9c and project 4d7a7d854e5047be8182fcc02f68c125. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:45:04 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:45:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-c4461ff4-5d0c-47a7-8172-624a19b85434 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.708941 Apr 19 15:45:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 49/147] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:45:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:45:05 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2aa3daec-8323-4f03-871d-0d8f6bf081fe tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:05 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-2aa3daec-8323-4f03-871d-0d8f6bf081fe tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:05 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:05 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-2aa3daec-8323-4f03-871d-0d8f6bf081fe tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:05 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-2aa3daec-8323-4f03-871d-0d8f6bf081fe tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 200 len: 1211 microversion: 2.1 time: 0.085967 Apr 19 15:45:05 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:05 2023] GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}, {"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:45:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:45:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-b57c676b-08b2-41ab-8c4c-4f3a3491179f req-89c7883b-d24f-4f1f-b94e-b4e520166807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040360 Apr 19 15:45:05 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:07 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] Creating event network-changed:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:45:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-ea38538f-3ebc-419e-8b3b-74bcab396ea4 req-c3ef5d9f-d4c6-4f9d-8eca-b93b8325c9e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038276 Apr 19 15:45:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=13 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:45:09 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 HTTP/1.1 Apr 19 15:45:09 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:45:09 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:45:09 user devstack@n-api.service[72850]: Connection: close Apr 19 15:45:09 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:45:09 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:45:09 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:45:09 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:45:09 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:45:09 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:45:09 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:45:09 user devstack@n-api.service[72850]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:45:09 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:45:09 user devstack@n-api.service[72850]: method: > Apr 19 15:45:09 user devstack@n-api.service[72850]: exception: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:45:09 user devstack@n-api.service[72850]: action_args: {'id': 'c709ad03-162e-408f-af2b-072b5c041a89'} Apr 19 15:45:09 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:45:09 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:45:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-7ae3a225-ee51-46c7-84a2-38e3413e066d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 404 len: 111 microversion: 2.20 time: 0.037767 Apr 19 15:45:09 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 52/151] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:45:09 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:45:09 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-7cb31d24-cd53-47d9-8f0c-31cc83ba7300 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '.version_select at 0x7f11e0c38f70>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:09 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-7cb31d24-cd53-47d9-8f0c-31cc83ba7300 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086142111" status: 204 len: 0 microversion: 2.20 time: 0.023446 Apr 19 15:45:09 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 50/152] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 19 15:45:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086142111 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:45:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] Creating event network-vif-plugged:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:45:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-3524a6a1-13e9-44e6-aafc-0787fa8204c5 req-bd085da4-9fa7-4d53-82e7-8cc6d82d1549 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Apr 19 15:45:10 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 51/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:10 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e4158e84-1e60-4014-8688-9ef5dbc3377d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Action: 'create', calling method: .version_select at 0x7f11e0d3b370>, body: {"keypair": {"name": "tempest-keypair-1190548682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZPVXhsYt+Bx+HPj1MZNTDnOGTGyYlU+EcHpa/3aaHvO9pdrM+zEwXcPc60PkzRCsiJG8Tad7t9G58pUV+8yepImyqvYAwfGNClcbR9IQFeqGs1+lII//DzBpFSDV5qOA=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:10 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e4158e84-1e60-4014-8688-9ef5dbc3377d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for project c42f3c3da3f945a1a946db703408fd69. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:10 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e4158e84-1e60-4014-8688-9ef5dbc3377d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for user d00ada35fa344f1cb23f3b6470a87d99 and project c42f3c3da3f945a1a946db703408fd69. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:10 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e4158e84-1e60-4014-8688-9ef5dbc3377d tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051389 Apr 19 15:45:10 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 53/154] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 15:45:10 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:11 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:11 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-465246b9-b555-44cd-b5a7-03d01f851472 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.384724 Apr 19 15:45:11 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:10 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:11 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:11 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-0a40e59e-53ce-4aa8-9a28-cf20ad16f813 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.411212 Apr 19 15:45:11 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 52/156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:11 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:12 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] Creating event network-vif-plugged:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:45:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-03bb0cd5-6a18-4cc2-9dd3-9d473d13e99a req-548cf6f0-f4f8-4f0a-8aa4-0b42fabdbe5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Apr 19 15:45:12 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 54/157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:12 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1527181845", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8a84383a-b04d-43d2-b8fa-475db387d9f3"}], "security_groups": [{"name": "tempest-securitygroup--340066921"}], "key_name": "tempest-keypair-1190548682", "user_data": "}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:12 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] validate_networks() for [('8a84383a-b04d-43d2-b8fa-475db387d9f3', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for project c42f3c3da3f945a1a946db703408fd69. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Getting quotas for user d00ada35fa344f1cb23f3b6470a87d99 and project c42f3c3da3f945a1a946db703408fd69. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:45:13 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:45:13 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a15d14cc-d530-4503-966f-f3dede3747d5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.202960 Apr 19 15:45:13 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 52/158] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:45:12 2023] POST /compute/v2.1/servers => generated 399 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:45:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:13 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:13 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:13 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-d3bdfe61-0cdc-46c9-a357-a4f69994da12 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 200 len: 1276 microversion: 2.20 time: 0.087317 Apr 19 15:45:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:45:13 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:45:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1138145174", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "32c3e048-3dee-4ebc-b028-ef87b79a1668"}]}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:15 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] validate_networks() for [('32c3e048-3dee-4ebc-b028-ef87b79a1668', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for user 1f9882d12b0549c7ba8d6f3fe436e86c and project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:45:17 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:45:17 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e5b8c907-f680-4aa1-8ede-59e2032916d4 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.615165 Apr 19 15:45:17 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 55/160] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:45:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:45:17 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:17 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:17 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:17 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:17 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-f5e9dee1-6e37-4b4e-89f9-0fc708ef14b8 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032" status: 200 len: 1395 microversion: 2.87 time: 0.078115 Apr 19 15:45:17 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 53/161] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:45:17 2023] GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032 => generated 1395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:45:17 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:17 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] Creating event network-changed:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:45:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-fce4a874-37c7-4f35-b701-48df52ab2c58 req-d90151f3-5ab0-4d01-834d-bd9308e06778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053382 Apr 19 15:45:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "name": "network-vif-plugged", "status": "completed", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] Creating event network-vif-plugged:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:45:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-4e591ca9-d072-46d8-b212-df08e4e28ea2 req-048cd566-f537-42b2-acdd-9a0b3a96e720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Apr 19 15:45:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 56/163] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:22 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:22 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-98308332-d9a6-43ee-a7ce-826566819081 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc" status: 200 len: 1496 microversion: 2.1 time: 0.285215 Apr 19 15:45:22 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:22 2023] GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc => generated 1496 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:22 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ddac96-5681-4b40-862e-1887706c4032", "tag": "3b86394a-ad2c-473b-be64-641e344a81f1"}, {"server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "name": "network-vif-plugged", "status": "completed", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:22 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Creating event network-changed:3b86394a-ad2c-473b-be64-641e344a81f1 for instance c7ddac96-5681-4b40-862e-1887706c4032 on user Apr 19 15:45:22 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] Creating event network-vif-plugged:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:45:22 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-c3476028-2915-401a-a257-efa1433465f4 req-9c60864a-c655-460d-bc1d-29fbc09a923c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037890 Apr 19 15:45:22 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:25 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ddac96-5681-4b40-862e-1887706c4032", "name": "network-vif-deleted", "tag": "3b86394a-ad2c-473b-be64-641e344a81f1"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:25 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:25 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:25 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:25 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.compute.server_external_events [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] Unable to find a host for instance c7ddac96-5681-4b40-862e-1887706c4032. Dropping event network-vif-deleted {{(pid=72850) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 15:45:25 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-373cf270-7ad5-40b7-99ff-3e101394d6e6 req-cc10eaad-c4a7-41b6-a7dd-ddae323d317a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036937 Apr 19 15:45:25 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 57/166] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 15:45:25 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:26 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a0df7828-c654-4a11-8c4e-b6b409119924 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Action: 'create', calling method: .version_select at 0x7f11e0cd2680>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1610859807", "metadata": {"Type": "work"}}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:26 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a0df7828-c654-4a11-8c4e-b6b409119924 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.585870 Apr 19 15:45:26 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 55/167] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 15:45:25 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 588 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 15:45:26 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=8 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:26 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-370ee6a9-66b1-4e0a-b90a-b0f77efddd2b tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Calling method '.version_select at 0x7f11e0b12a70>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:26 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-370ee6a9-66b1-4e0a-b90a-b0f77efddd2b tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236" status: 200 len: 350 microversion: 2.1 time: 0.086170 Apr 19 15:45:26 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:45:26 2023] GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:27 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-107d59a9-d0f3-4f43-9811-8232b9e2cde6 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Calling method '.version_select at 0x7f11e0c14f70>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:27 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:27 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=12 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:27 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-107d59a9-d0f3-4f43-9811-8232b9e2cde6 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236" status: 200 len: 350 microversion: 2.1 time: 0.072289 Apr 19 15:45:27 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 58/169] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:45:27 2023] GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236 => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:27 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=8 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:27 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d5b1782e-8fab-42a0-83ec-aecf4884eef1 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Calling method '.version_select at 0x7f11e15db370>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:27 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d5b1782e-8fab-42a0-83ec-aecf4884eef1 tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236" status: 202 len: 0 microversion: 2.1 time: 0.119071 Apr 19 15:45:27 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:45:27 2023] DELETE /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:45:27 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-427dcc3a-7512-4ef6-9916-3b90ba14cada tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Calling method '.version_select at 0x7f11e0b11ea0>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:27 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-427dcc3a-7512-4ef6-9916-3b90ba14cada tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] HTTP exception thrown: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. Apr 19 15:45:27 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-427dcc3a-7512-4ef6-9916-3b90ba14cada tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Request method failure captured: Apr 19 15:45:27 user devstack@n-api.service[72851]: request: GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236 HTTP/1.1 Apr 19 15:45:27 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:45:27 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:45:27 user devstack@n-api.service[72851]: Connection: close Apr 19 15:45:27 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:45:27 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:45:27 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:45:27 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:45:27 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAyVCgJT0AFJiMVuZTsClPlb3YGr2qCvmPsAZeFV3Y4AdIgmAZuYtbiLoCLZtHPcuYi7oy3yqO-mJDCf7WkTMEun3jyoEcdZ3t8uaPVQ7c2wmR_fAD7peEL4GH2OqLmb3d4xsQP92b-GERkvT3Tn1n7QEgxu9t57X_0PZSaAtTFTG0w Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Project-Id: dd846211f6c24b77b2c3f36385775cd0 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Project-Name: tempest-VolumesGetTestJSON-1353324876 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd846211f6c24b77b2c3f36385775cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dd846211f6c24b77b2c3f36385775cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dd846211f6c24b77b2c3f36385775cd0"}]}] Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Tenant: tempest-VolumesGetTestJSON-1353324876 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Tenant-Id: dd846211f6c24b77b2c3f36385775cd0 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-VolumesGetTestJSON-1353324876 Apr 19 15:45:27 user devstack@n-api.service[72851]: X-User: tempest-VolumesGetTestJSON-1353324876-project-member Apr 19 15:45:27 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:45:27 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:45:27 user devstack@n-api.service[72851]: X-User-Id: 9ff0bc7df84e4ef9ad14788e1fc0bfef Apr 19 15:45:27 user devstack@n-api.service[72851]: X-User-Name: tempest-VolumesGetTestJSON-1353324876-project-member Apr 19 15:45:27 user devstack@n-api.service[72851]: method: Apr 19 15:45:27 user devstack@n-api.service[72851]: exception: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. Apr 19 15:45:27 user devstack@n-api.service[72851]: action_args: {'id': '3decf513-d8a7-4087-af61-22a69090d236'} Apr 19 15:45:27 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. (HTTP 404) (Request-ID: req-878a0ae6-d09b-4c90-8916-88da87c58ba3) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. Apr 19 15:45:27 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:27 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-427dcc3a-7512-4ef6-9916-3b90ba14cada tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] Returning 404 to user: Volume 3decf513-d8a7-4087-af61-22a69090d236 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:45:27 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-427dcc3a-7512-4ef6-9916-3b90ba14cada tempest-VolumesGetTestJSON-1353324876 tempest-VolumesGetTestJSON-1353324876-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236" status: 404 len: 109 microversion: 2.1 time: 0.043267 Apr 19 15:45:27 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:45:27 2023] GET /compute/v2.1/os-volumes/3decf513-d8a7-4087-af61-22a69090d236 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:35 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] HTTP exception thrown: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Request method failure captured: Apr 19 15:45:35 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f HTTP/1.1 Apr 19 15:45:35 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:45:35 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:45:35 user devstack@n-api.service[72850]: Connection: close Apr 19 15:45:35 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:45:35 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:45:35 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:45:35 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:45:35 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvYaqaVIdJOEVw6ecZOfAVbbNj1nDgvxUiwy4lKaUxSKupC_VAWKJj5geExiFdInz03JSGupYFRkyRaR52v92VSqbT0rzZjfUBShI808gTC_Fx90fjXLvokAUg7XnLc3d8R2Z2fU1jN99PLekaJ1iONkl7VqdTHUSVHppFcNixUXy0 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Project-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb3cf6df3f3c4b77a484366eec229734"}]}] Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Tenant-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-User: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:35 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:45:35 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:45:35 user devstack@n-api.service[72850]: X-User-Id: 6f0a32c0350843bd8344a46638f58c86 Apr 19 15:45:35 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:35 user devstack@n-api.service[72850]: method: > Apr 19 15:45:35 user devstack@n-api.service[72850]: exception: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:35 user devstack@n-api.service[72850]: action_args: {'id': '9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f'} Apr 19 15:45:35 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Returning 404 to user: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:45:35 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-9a691e33-491e-4708-ae45-a6ec26223292 tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 404 len: 111 microversion: 2.1 time: 0.031791 Apr 19 15:45:35 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:35 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:45:35 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:35 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=24 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:35 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-80b794f4-afcc-4b8b-b4a4-6a8fa78d189c tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '.version_select at 0x7f11e0cd3370>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:35 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-80b794f4-afcc-4b8b-b4a4-6a8fa78d189c tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240069358" status: 202 len: 0 microversion: 2.1 time: 0.025496 Apr 19 15:45:35 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:45:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240069358 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] HTTP exception thrown: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Request method failure captured: Apr 19 15:45:36 user devstack@n-api.service[72851]: request: DELETE /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f HTTP/1.1 Apr 19 15:45:36 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:45:36 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:45:36 user devstack@n-api.service[72851]: Connection: close Apr 19 15:45:36 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:45:36 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:45:36 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:45:36 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:45:36 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAvYaqaVIdJOEVw6ecZOfAVbbNj1nDgvxUiwy4lKaUxSKupC_VAWKJj5geExiFdInz03JSGupYFRkyRaR52v92VSqbT0rzZjfUBShI808gTC_Fx90fjXLvokAUg7XnLc3d8R2Z2fU1jN99PLekaJ1iONkl7VqdTHUSVHppFcNixUXy0 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Project-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb3cf6df3f3c4b77a484366eec229734"}]}] Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Tenant-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-User: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:36 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:45:36 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:45:36 user devstack@n-api.service[72851]: X-User-Id: 6f0a32c0350843bd8344a46638f58c86 Apr 19 15:45:36 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:36 user devstack@n-api.service[72851]: method: > Apr 19 15:45:36 user devstack@n-api.service[72851]: exception: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72851]: action_args: {'id': '9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f'} Apr 19 15:45:36 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Returning 404 to user: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:45:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-ac7a7389-7bf8-461d-8860-d357559ed9ea tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 404 len: 111 microversion: 2.1 time: 0.045459 Apr 19 15:45:36 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:45:36 2023] DELETE /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] [instance: 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:36 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] HTTP exception thrown: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Request method failure captured: Apr 19 15:45:36 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f HTTP/1.1 Apr 19 15:45:36 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:45:36 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:45:36 user devstack@n-api.service[72850]: Connection: close Apr 19 15:45:36 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:45:36 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:45:36 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:45:36 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:45:36 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvYaqaVIdJOEVw6ecZOfAVbbNj1nDgvxUiwy4lKaUxSKupC_VAWKJj5geExiFdInz03JSGupYFRkyRaR52v92VSqbT0rzZjfUBShI808gTC_Fx90fjXLvokAUg7XnLc3d8R2Z2fU1jN99PLekaJ1iONkl7VqdTHUSVHppFcNixUXy0 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Project-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb3cf6df3f3c4b77a484366eec229734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb3cf6df3f3c4b77a484366eec229734"}]}] Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Tenant-Id: bb3cf6df3f3c4b77a484366eec229734 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-599180046 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-User: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:36 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:45:36 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:45:36 user devstack@n-api.service[72850]: X-User-Id: 6f0a32c0350843bd8344a46638f58c86 Apr 19 15:45:36 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-599180046-project-member Apr 19 15:45:36 user devstack@n-api.service[72850]: method: > Apr 19 15:45:36 user devstack@n-api.service[72850]: exception: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72850]: action_args: {'id': '9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f'} Apr 19 15:45:36 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. Apr 19 15:45:36 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:45:36 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] Returning 404 to user: Instance 9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:45:36 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-fec6114b-4887-4d3a-bae3-77608f54a42d tempest-AttachSCSIVolumeTestJSON-599180046 tempest-AttachSCSIVolumeTestJSON-599180046-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f" status: 404 len: 111 microversion: 2.1 time: 0.041501 Apr 19 15:45:36 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 60/175] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:36 2023] GET /compute/v2.1/servers/9c4f3f2a-2bd1-4faf-8449-dc1b0dc6023f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-0df9de48-9989-48fd-a85b-87ceaa406b32 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Action: 'create', calling method: .version_select at 0x7f11e0931630>, body: {"keypair": {"name": "tempest-keypair-1816485432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4ktJ84v9Tj5MCTGyrrMvarCgctulWpQ1xFJVtc9KMLChBcLzOQW7qfXzys6l5fUaFA08SSLsiMLOzsaWthezHJLJ9PAASOdDHudK+BIUKf/oT05VL1DoNQ5EWfLTNHhQ=="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:51 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-0df9de48-9989-48fd-a85b-87ceaa406b32 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Getting quotas for project 9e89db22a865434daa71b4b01f7bc063. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:51 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-0df9de48-9989-48fd-a85b-87ceaa406b32 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Getting quotas for user e0c14c63019443df80be92da1b5761c3 and project 9e89db22a865434daa71b4b01f7bc063. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-0df9de48-9989-48fd-a85b-87ceaa406b32 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153923 Apr 19 15:45:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 59/176] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:45:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:51 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-9d9618df-acaf-485b-bc4d-c99708d9ba7a tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 200 len: 1490 microversion: 2.1 time: 0.621858 Apr 19 15:45:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 58/177] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:51 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 1490 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:52 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1942984265", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "2553e11f-f1ac-4e67-8173-bd24612c8b0b"}], "security_groups": [{"name": "tempest-securitygroup--858903746"}], "key_name": "tempest-keypair-1816485432", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:52 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:52 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=13 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:45:52 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] validate_networks() for [('2553e11f-f1ac-4e67-8173-bd24612c8b0b', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Getting quotas for project 9e89db22a865434daa71b4b01f7bc063. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Getting quotas for user e0c14c63019443df80be92da1b5761c3 and project 9e89db22a865434daa71b4b01f7bc063. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:45:53 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:45:53 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-13d80154-d351-4f50-9d05-97884a5fe312 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.688613 Apr 19 15:45:53 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 61/178] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:45:52 2023] POST /compute/v2.1/servers => generated 403 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:45:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-b69876ee-60c1-4196-ac19-d9a463b19f33 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:53 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-b69876ee-60c1-4196-ac19-d9a463b19f33 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:53 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-b69876ee-60c1-4196-ac19-d9a463b19f33 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c14c63019443df80be92da1b5761c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89db22a865434daa71b4b01f7bc063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:53 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-b69876ee-60c1-4196-ac19-d9a463b19f33 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 200 len: 1240 microversion: 2.1 time: 0.074157 Apr 19 15:45:53 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:53 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:55 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:45:55 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-c30b1c2e-ffb0-4c64-a23e-7183b7115bba tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 200 len: 1495 microversion: 2.1 time: 0.326563 Apr 19 15:45:55 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 59/180] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:45:55 2023] GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 1495 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:45:56 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] Creating event network-changed:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:45:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-d9f09aba-77ff-476c-9d41-ce7bb42fd9db req-259d3558-a7ae-4727-9fbc-3792b690226c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037695 Apr 19 15:45:56 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:45:58 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "name": "network-vif-plugged", "status": "completed", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:45:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:45:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:45:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:45:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] Creating event network-vif-plugged:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:45:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-a68531cb-640e-4f88-923e-7d8b37c6f37a req-4ed6ccf8-bfc5-40c9-9e97-5be7b0e6575f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037412 Apr 19 15:45:58 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:00 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "name": "network-vif-plugged", "status": "completed", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:00 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] Creating event network-vif-plugged:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:46:00 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-503cf848-83b0-4e2c-ac98-52f0306d578b req-d99273da-ea6b-4e5c-b3a5-a53bdd4a516f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Apr 19 15:46:00 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 60/183] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:03 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:04 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:04 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:04 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-eadfce95-4688-4466-b934-8e3c5919771c tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 200 len: 1587 microversion: 2.20 time: 0.287286 Apr 19 15:46:04 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:46:03 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 1587 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.objects.instance [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lazy-loading 'fault' on Instance uuid c7ddac96-5681-4b40-862e-1887706c4032 {{(pid=72851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-e5f4d313-9194-4c30-9760-3cf347675e94 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032" status: 200 len: 1650 microversion: 2.87 time: 0.103219 Apr 19 15:46:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 62/185] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:46:07 2023] GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032 => generated 1650 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Doing local delete in cell 1d1abc72-4a1e-46ad-b3ce-2880abea9047(cell1) {{(pid=72849) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:07 user devstack@n-api.service[72849]: WARNING nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] instance's host None is down, deleting from database Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 15:46:07 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=72849) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 15:46:07 user devstack@n-api.service[72849]: WARNING nova.compute.api [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 15:46:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-14b4bbcf-c140-4694-9418-169bd9594d5b tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032" status: 204 len: 0 microversion: 2.87 time: 0.791436 Apr 19 15:46:08 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 61/186] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:46:07 2023] DELETE /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: c7ddac96-5681-4b40-862e-1887706c4032] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:08 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] HTTP exception thrown: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Request method failure captured: Apr 19 15:46:08 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032 HTTP/1.1 Apr 19 15:46:08 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:46:08 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:46:08 user devstack@n-api.service[72850]: Connection: close Apr 19 15:46:08 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:46:08 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:46:08 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:46:08 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:46:08 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvX9wkXYcBUkCUV5Z_aptFiHC4gHuenqpc3O-u8BieCcTD-HfeYkz6AW9DUOHsMNOh1CbJ0QnbyQ-TMDoC_R4aMf-YwS3ll6iTY-jEtX8W1vjNcpwGRXWTu4J5EZoA_44X_gQ9q1jQEiqwgqWsrkhV2uSX49Zm2n4rrh05tUm289bY Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Project-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e73f4cb2217c40d8ba22e2548edf0408"}]}] Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Tenant-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:46:08 user devstack@n-api.service[72850]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:46:08 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:46:08 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:46:08 user devstack@n-api.service[72850]: X-User-Id: 1f9882d12b0549c7ba8d6f3fe436e86c Apr 19 15:46:08 user devstack@n-api.service[72850]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:46:08 user devstack@n-api.service[72850]: method: > Apr 19 15:46:08 user devstack@n-api.service[72850]: exception: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. Apr 19 15:46:08 user devstack@n-api.service[72850]: action_args: {'id': 'c7ddac96-5681-4b40-862e-1887706c4032'} Apr 19 15:46:08 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. Apr 19 15:46:08 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:46:08 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Returning 404 to user: Instance c7ddac96-5681-4b40-862e-1887706c4032 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:46:08 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-1aec1a0e-3af3-4bfe-b1a8-b3ed49446f93 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032" status: 404 len: 111 microversion: 2.87 time: 0.031905 Apr 19 15:46:08 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 64/187] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:46:08 2023] GET /compute/v2.1/servers/c7ddac96-5681-4b40-862e-1887706c4032 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:46:08 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1376325141", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "32c3e048-3dee-4ebc-b028-ef87b79a1668"}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:08 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] validate_networks() for [('32c3e048-3dee-4ebc-b028-ef87b79a1668', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for user 1f9882d12b0549c7ba8d6f3fe436e86c and project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:46:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:46:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8fbd7190-52c2-4a04-be0c-068bfda0f373 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.577571 Apr 19 15:46:09 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 63/188] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:46:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:46:09 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:09 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:09 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:09 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:09 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:09 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1c7d76cd-891b-4ce8-82db-01a10d3cedca tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 200 len: 1395 microversion: 2.87 time: 0.090877 Apr 19 15:46:09 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 62/189] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:46:09 2023] GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 1395 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:46:12 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] Creating event network-changed:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:46:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-224fc578-5cfa-4e73-b278-8aeed73abc42 req-457efb35-7ff2-4e5e-92ef-53f7a3695a35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034536 Apr 19 15:46:12 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:13 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-23f4ff86-7d30-44b0-9640-4731ee0ef8a9 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.370837 Apr 19 15:46:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:46:13 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:46:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "name": "network-vif-plugged", "status": "completed", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:14 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] Creating event network-vif-plugged:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:46:14 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-91238722-45e9-40ad-8056-f5faf4e732af req-142d2622-0bfa-4dd5-9be5-70547fab3913 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 Apr 19 15:46:14 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 63/192] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:16 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "name": "network-vif-plugged", "status": "completed", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:17 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] Creating event network-vif-plugged:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:46:17 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-fbb5f3aa-4ca4-4a5e-bb84-f9c2198c2e1f req-42a78ffd-4308-43a8-9a75-104a185117e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045944 Apr 19 15:46:17 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 66/193] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=18 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:24 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:46:24 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-4e9e9a07-b5ed-4f8b-be8f-f01fb29d3fc1 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc" status: 204 len: 0 microversion: 2.1 time: 0.135036 Apr 19 15:46:24 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:46:24 2023] DELETE /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "name": "network-vif-unplugged", "status": "completed", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:24 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=17 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:24 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] Creating event network-vif-unplugged:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:46:24 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-713ce56b-521c-44a1-bcad-a78166a7a512 req-9a81fcb6-a674-4fd6-b637-d78687e72b66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039906 Apr 19 15:46:24 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 67/195] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:24 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:24 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a4d8f08a-58fb-4b43-a5cf-149bf0d99f46 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc" status: 200 len: 1502 microversion: 2.1 time: 0.255991 Apr 19 15:46:24 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:46:24 2023] GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:46:25 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "name": "network-vif-deleted", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:25 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:25 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] Creating event network-vif-deleted:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:46:25 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-49e5ead7-afac-4060-a7d6-d6c9c96d8609 req-30c7ced8-0681-476b-93cb-920452ac6be9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Apr 19 15:46:25 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 66/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:26 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5678fd0-2de9-4d67-9936-50aa31d6c6bc", "name": "network-vif-plugged", "status": "completed", "tag": "ac47f9d5-6404-4a37-855c-36d5f85b7058"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] Creating event network-vif-plugged:ac47f9d5-6404-4a37-855c-36d5f85b7058 for instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc on user Apr 19 15:46:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-0d81fcfa-7513-4266-9892-79fe59463db9 req-a36204d4-4a4d-439f-92d3-79f36f7991d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028982 Apr 19 15:46:26 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 68/198] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=5 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:43 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c14c63019443df80be92da1b5761c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89db22a865434daa71b4b01f7bc063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:43 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-4ba31ea1-7ebc-4f69-a61e-574c4a9dd83e tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 200 len: 1554 microversion: 2.1 time: 0.239534 Apr 19 15:46:43 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:46:43 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:52 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-fcb6aa43-6812-40a1-aa8e-1751e68da785 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7" status: 200 len: 1504 microversion: 2.1 time: 0.254922 Apr 19 15:46:52 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:46:51 2023] GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=3 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:55 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:46:55 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-40a1f82e-4ec9-41f4-a836-1b006f835c3e tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 204 len: 0 microversion: 2.1 time: 0.151219 Apr 19 15:46:55 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:46:55 2023] DELETE /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:55 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "name": "network-vif-unplugged", "status": "completed", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:55 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] Creating event network-vif-unplugged:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:46:55 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-bbcfa2b6-a00c-47c2-b497-5c3d423f5919 req-e4164edc-b799-4c89-91a9-fc5a5072e5e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033787 Apr 19 15:46:55 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 68/202] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:56 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:56 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-77cd69c5-1e82-46b6-b422-d0e9fede48f8 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 200 len: 1501 microversion: 2.1 time: 0.424169 Apr 19 15:46:56 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 66/203] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:46:55 2023] GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:46:56 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "name": "network-vif-deleted", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] Creating event network-vif-deleted:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:46:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-641a0a23-86a6-4c89-ac24-b8be6e328fed req-140c2e34-272a-46f0-aca8-0ab2f3e580af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029276 Apr 19 15:46:56 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 70/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:58 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da2a2d-21a2-44b7-906a-29900a51ccb3", "name": "network-vif-plugged", "status": "completed", "tag": "e4544429-875e-4942-8dcd-d52032492645"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:46:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] Creating event network-vif-plugged:e4544429-875e-4942-8dcd-d52032492645 for instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 on user Apr 19 15:46:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-0613ec42-352c-42ac-b7ac-3d67c658dbac req-0df1339b-71e2-4142-8014-9e21164b8d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032343 Apr 19 15:46:58 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:59 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:46:59 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-4262a523-f0bb-481f-9c78-29b22a403d55 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 200 len: 1690 microversion: 2.87 time: 0.272942 Apr 19 15:46:59 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 67/206] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:46:59 2023] GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-48f67a19-4f71-4536-8f53-73684cdeb5a8 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.160963 Apr 19 15:47:04 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 71/207] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 15:47:04 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3/os-interface => generated 282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:47:05 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] Creating event network-changed:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:47:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-b4c9090f-246e-4034-874e-8ee4b29d4337 req-2d3f8b27-f503-4dab-b9c4-958dc5c952af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Apr 19 15:47:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-df0426ea-38bf-43b2-8b10-7fe21610fc55 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3/ips" status: 200 len: 110 microversion: 2.20 time: 0.037298 Apr 19 15:47:05 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 68/209] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 15:47:05 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:06 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:47:06 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-3657d3f3-de8c-496e-945e-6a10b23cbe28 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 204 len: 0 microversion: 2.20 time: 0.109356 Apr 19 15:47:06 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 72/210] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:47:06 2023] DELETE /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:07 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "name": "network-vif-unplugged", "status": "completed", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:07 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:07 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] Creating event network-vif-unplugged:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:47:07 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-45cb95c6-359c-48f2-b4d2-48ccb6f4c7c0 req-a2dc46a0-0d30-46f9-bbbc-1bbc82935491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033148 Apr 19 15:47:07 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd00ada35fa344f1cb23f3b6470a87d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42f3c3da3f945a1a946db703408fd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-28ea992b-bd5f-436d-b4ca-46ef75e760ea tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 200 len: 1711 microversion: 2.20 time: 0.505003 Apr 19 15:47:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:47:06 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 1711 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 15:47:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "name": "network-vif-plugged", "status": "completed", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}, {"server_uuid": "8a8b4cc3-3220-4452-8ced-8c641fee8cd3", "name": "network-vif-deleted", "tag": "30ba0902-606d-47b7-a32b-4c5d4dc95df5"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Creating event network-vif-plugged:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:47:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] Creating event network-vif-deleted:30ba0902-606d-47b7-a32b-4c5d4dc95df5 for instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 on user Apr 19 15:47:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-52f9a398-16c8-41a3-a118-633f288b7c37 req-b2b59491-17da-4e7a-8b83-e3248635c3d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031939 Apr 19 15:47:09 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 73/213] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:13 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:13 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-05623fd4-57b7-4616-97e1-afd3a061aa8a tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.211890 Apr 19 15:47:13 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:13 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:14 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:14 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-9216718f-d839-4f2f-acee-463ca4476ecc tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.142016 Apr 19 15:47:14 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:13 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:14 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:14 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-17308dd7-eac9-4c10-8382-d0378a04c02c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.334995 Apr 19 15:47:14 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:14 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: e5678fd0-2de9-4d67-9936-50aa31d6c6bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:14 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] HTTP exception thrown: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Request method failure captured: Apr 19 15:47:14 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc HTTP/1.1 Apr 19 15:47:14 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:47:14 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:47:14 user devstack@n-api.service[72849]: Connection: close Apr 19 15:47:14 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:47:14 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:47:14 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:47:14 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:47:14 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAvP6KOlr_AkHQ-6DIVUqJYOGzsUlTvES7xjTkC_C4NdLyMPzb6us4qQZ7QBXb1w7q_bLQevK2-U8HRNmtHidZTUNvBe29siLQOentgJnYxWjP8lupsQUBZVZPM2SokSrQ55peC2PYfKACCgBl1hsjI1cJITk3pliaPYtFPQVaara2M Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Project-Id: c81ec3d570254ba98de839dff3a4e38d Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c81ec3d570254ba98de839dff3a4e38d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c81ec3d570254ba98de839dff3a4e38d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c81ec3d570254ba98de839dff3a4e38d"}]}] Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Tenant-Id: c81ec3d570254ba98de839dff3a4e38d Apr 19 15:47:14 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:47:14 user devstack@n-api.service[72849]: X-User: tempest-VolumesAdminNegativeTest-1882279775-project-member Apr 19 15:47:14 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:47:14 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:47:14 user devstack@n-api.service[72849]: X-User-Id: ea2dcb51753d4099805e8589c93b8143 Apr 19 15:47:14 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesAdminNegativeTest-1882279775-project-member Apr 19 15:47:14 user devstack@n-api.service[72849]: method: > Apr 19 15:47:14 user devstack@n-api.service[72849]: exception: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. Apr 19 15:47:14 user devstack@n-api.service[72849]: action_args: {'id': 'e5678fd0-2de9-4d67-9936-50aa31d6c6bc'} Apr 19 15:47:14 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. Apr 19 15:47:14 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Returning 404 to user: Instance e5678fd0-2de9-4d67-9936-50aa31d6c6bc could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:14 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-23a85198-cf0c-403f-b42d-63dbb2dbc2a0 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc" status: 404 len: 111 microversion: 2.1 time: 0.032787 Apr 19 15:47:14 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:14 2023] GET /compute/v2.1/servers/e5678fd0-2de9-4d67-9936-50aa31d6c6bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:47:14 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:14 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:15 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:47:15 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-d46d2f6e-ce90-4efc-b6ad-6876fcbbd9ee tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262" status: 204 len: 0 microversion: 2.1 time: 0.115051 Apr 19 15:47:15 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:47:14 2023] DELETE /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:15 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "name": "network-vif-unplugged", "status": "completed", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:15 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] Creating event network-vif-unplugged:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:47:15 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2dcb51753d4099805e8589c93b8143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81ec3d570254ba98de839dff3a4e38d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-97e7555a-245d-49f4-9fea-944c3539620d req-19fa04ab-3c3f-493b-bdd5-539c1bbf0b18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034503 Apr 19 15:47:15 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 72/219] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:15 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f2a7bf23-ef1e-4647-b242-9a015f24ee4f tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262" status: 200 len: 1671 microversion: 2.1 time: 0.274889 Apr 19 15:47:15 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:15 2023] GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 => generated 1671 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:17 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "name": "network-vif-deleted", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] Creating event network-vif-deleted:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:47:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-d878a81e-8ee9-44a3-9780-08efa0e853a5 req-edeacd19-b32f-45ad-94f0-44e49e6e4df3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027284 Apr 19 15:47:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:17 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56bbb31-844d-4fe5-ac87-f1332893e262", "name": "network-vif-plugged", "status": "completed", "tag": "f85699bc-0bba-4b6e-bacb-df0c78c7a991"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] Creating event network-vif-plugged:f85699bc-0bba-4b6e-bacb-df0c78c7a991 for instance a56bbb31-844d-4fe5-ac87-f1332893e262 on user Apr 19 15:47:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-992e5cb4-add5-42fa-bac5-a42edc11ec6d req-1c55540d-0856-433d-970f-4c8367042ac4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030518 Apr 19 15:47:17 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 73/222] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-1c5ce7dc-87ef-456e-973e-b4be2fced1ef tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.202686 Apr 19 15:47:44 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:47:43 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03/os-interface => generated 283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=18 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=30 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1642019050"}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] Creating event network-changed:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:47:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-ea56f41a-1211-4d30-8251-931283ca8193 req-65305b9b-5f66-4219-aab4-0410d12e7c1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096233 Apr 19 15:47:44 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e5342dc4-0043-4e70-9ba8-baf83692cc64 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03/action" status: 202 len: 0 microversion: 2.1 time: 0.892926 Apr 19 15:47:45 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 74/225] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 15:47:44 2023] POST /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03/action => generated 0 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 19 15:47:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-86c792e1-c0e9-4b35-99ad-92ed843888a3 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '.version_select at 0x7f11e0a3b7f0>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-86c792e1-c0e9-4b35-99ad-92ed843888a3 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6" status: 200 len: 1609 microversion: 2.1 time: 0.052181 Apr 19 15:47:45 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 15:47:45 2023] GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6 => generated 1609 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:46 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] HTTP exception thrown: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Request method failure captured: Apr 19 15:47:46 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 HTTP/1.1 Apr 19 15:47:46 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:47:46 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:47:46 user devstack@n-api.service[72851]: Connection: close Apr 19 15:47:46 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:47:46 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:47:46 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:47:46 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:47:46 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAwPzsTq0a2Gf6cQJxPRTNhjpdeNPpmnFeKUTW-_Q6QQnk7YR5uLXzi7-mQFUknr9W64CFu3pp-7pid9_1iv02RQC1ab-ynOf7n00qeuvfdaD3sUz5NwJLHi7h1is66_RAV5ThtLfqiZ_LzPfvlzPwnnSmiVjW1RXu5Vg4WTOL9qVnQ Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Project-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Project-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d7a7d854e5047be8182fcc02f68c125"}]}] Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Tenant: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Tenant-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:47:46 user devstack@n-api.service[72851]: X-User: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:47:46 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:47:46 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:47:46 user devstack@n-api.service[72851]: X-User-Id: f4f54b80641e48dfbc83ba21c1decb9c Apr 19 15:47:46 user devstack@n-api.service[72851]: X-User-Name: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:47:46 user devstack@n-api.service[72851]: method: > Apr 19 15:47:46 user devstack@n-api.service[72851]: exception: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:47:46 user devstack@n-api.service[72851]: action_args: {'id': '16da2a2d-21a2-44b7-906a-29900a51ccb3'} Apr 19 15:47:46 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:47:46 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:46 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Returning 404 to user: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:46 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-02b7d674-1e9e-43a0-9e2a-aa07ae5c89c7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 404 len: 111 microversion: 2.1 time: 0.027364 Apr 19 15:47:46 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:46 2023] GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:46 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:46 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-fea2261a-1353-493f-b028-9b709ee581f7 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1495 microversion: 2.1 time: 0.239693 Apr 19 15:47:46 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:46 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:55 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:47:55 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-a2c9cfa4-85e9-4163-b4d9-3f377729fcd9 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 204 len: 0 microversion: 2.1 time: 0.115963 Apr 19 15:47:55 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:47:55 2023] DELETE /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:55 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:47:55 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-34868145-3bab-4e04-b2c7-9be47248b735 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 200 len: 1496 microversion: 2.1 time: 0.331355 Apr 19 15:47:55 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:47:55 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 1496 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:47:55 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-unplugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:55 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:55 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] Creating event network-vif-unplugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:47:55 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-a632dccb-f761-43c0-8c42-c19d9d64f1ff req-9f1ce8f2-d081-401d-89f8-c9dd4f863673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091484 Apr 19 15:47:55 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:47:57 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 HTTP/1.1 Apr 19 15:47:57 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:47:57 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:47:57 user devstack@n-api.service[72850]: Connection: close Apr 19 15:47:57 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:47:57 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:47:57 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:47:57 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:47:57 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:57 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:47:57 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:47:57 user devstack@n-api.service[72850]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:47:57 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:57 user devstack@n-api.service[72850]: method: > Apr 19 15:47:57 user devstack@n-api.service[72850]: exception: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:57 user devstack@n-api.service[72850]: action_args: {'id': '8a8b4cc3-3220-4452-8ced-8c641fee8cd3'} Apr 19 15:47:57 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-936ab1ff-cdf7-40c5-a61f-b1e492ac68e0 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 404 len: 111 microversion: 2.20 time: 0.129286 Apr 19 15:47:57 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 79/232] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:47:57 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:47:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-af3df74d-3f98-435c-bff2-b630abb04117 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '.version_select at 0x7f11e0b12dd0>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-af3df74d-3f98-435c-bff2-b630abb04117 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190548682" status: 204 len: 0 microversion: 2.20 time: 0.024493 Apr 19 15:47:57 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 78/233] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 19 15:47:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190548682 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:47:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-plugged", "status": "completed", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}, {"server_uuid": "aa34baf4-45e7-4aca-9bc7-fc36a5430ee1", "name": "network-vif-deleted", "tag": "6d779d54-9899-41f8-8dfe-d71348c14aee"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Creating event network-vif-plugged:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:47:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] Creating event network-vif-deleted:6d779d54-9899-41f8-8dfe-d71348c14aee for instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 on user Apr 19 15:47:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-70ac2c75-79ad-4c35-9ea9-04732918d6d7 req-cfaf18f5-69da-463b-9c78-8e73361a1b1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035414 Apr 19 15:47:57 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:47:58 user devstack@n-api.service[72850]: request: DELETE /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 HTTP/1.1 Apr 19 15:47:58 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:47:58 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:47:58 user devstack@n-api.service[72850]: Connection: close Apr 19 15:47:58 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:47:58 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:47:58 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:47:58 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:47:58 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72850]: method: > Apr 19 15:47:58 user devstack@n-api.service[72850]: exception: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: action_args: {'id': '8a8b4cc3-3220-4452-8ced-8c641fee8cd3'} Apr 19 15:47:58 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-2cb78ba0-c6f8-4655-afc0-d2b4867ffd2b tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 404 len: 111 microversion: 2.20 time: 0.028942 Apr 19 15:47:58 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 80/235] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:47:58 2023] DELETE /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: 8a8b4cc3-3220-4452-8ced-8c641fee8cd3] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:47:58 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 HTTP/1.1 Apr 19 15:47:58 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:47:58 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:47:58 user devstack@n-api.service[72851]: Connection: close Apr 19 15:47:58 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:47:58 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:47:58 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:47:58 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:47:58 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72851]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:47:58 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72851]: method: > Apr 19 15:47:58 user devstack@n-api.service[72851]: exception: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72851]: action_args: {'id': '8a8b4cc3-3220-4452-8ced-8c641fee8cd3'} Apr 19 15:47:58 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance 8a8b4cc3-3220-4452-8ced-8c641fee8cd3 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:58 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-de1d5104-fb76-4169-9f25-cb91fce4aab5 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3" status: 404 len: 111 microversion: 2.20 time: 0.030139 Apr 19 15:47:58 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:47:58 2023] GET /compute/v2.1/servers/8a8b4cc3-3220-4452-8ced-8c641fee8cd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:47:58 user devstack@n-api.service[72849]: request: DELETE /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 HTTP/1.1 Apr 19 15:47:58 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:47:58 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:47:58 user devstack@n-api.service[72849]: Connection: close Apr 19 15:47:58 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:47:58 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:47:58 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:47:58 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:47:58 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72849]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:47:58 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72849]: method: > Apr 19 15:47:58 user devstack@n-api.service[72849]: exception: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72849]: action_args: {'id': 'c709ad03-162e-408f-af2b-072b5c041a89'} Apr 19 15:47:58 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:58 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-9fa9724b-374f-4953-927a-9a53c5d8d812 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 404 len: 111 microversion: 2.20 time: 0.031759 Apr 19 15:47:58 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 78/237] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:47:58 2023] DELETE /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] [instance: c709ad03-162e-408f-af2b-072b5c041a89] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] HTTP exception thrown: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Request method failure captured: Apr 19 15:47:58 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 HTTP/1.1 Apr 19 15:47:58 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:47:58 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:47:58 user devstack@n-api.service[72850]: Connection: close Apr 19 15:47:58 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:47:58 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:47:58 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:47:58 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:47:58 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvY1GjGooyQiFJL12TBXLc6zb0Oc6cPKrcKCj_URS0IpA6lFsrTkX0wmqEZr4l56bCIjaOfGfsiqDIbBjNi1mk08T8n5Xp8xORHGB1jbheAci8edEqMJ3bMAyHoFyGhF6hEg9sVoFddPlgiLKIF0BS1Ss0aU76tFZDqfFsDv9w_QHw Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c42f3c3da3f945a1a946db703408fd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c42f3c3da3f945a1a946db703408fd69"}]}] Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant-Id: c42f3c3da3f945a1a946db703408fd69 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1426525044 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Id: d00ada35fa344f1cb23f3b6470a87d99 Apr 19 15:47:58 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1426525044-project-member Apr 19 15:47:58 user devstack@n-api.service[72850]: method: > Apr 19 15:47:58 user devstack@n-api.service[72850]: exception: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: action_args: {'id': 'c709ad03-162e-408f-af2b-072b5c041a89'} Apr 19 15:47:58 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. Apr 19 15:47:58 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:47:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] Returning 404 to user: Instance c709ad03-162e-408f-af2b-072b5c041a89 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:47:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-957f6910-3427-4c9e-b29e-3f4b10275565 tempest-AttachVolumeShelveTestJSON-1426525044 tempest-AttachVolumeShelveTestJSON-1426525044-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89" status: 404 len: 111 microversion: 2.20 time: 0.029847 Apr 19 15:47:58 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 81/238] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:47:58 2023] GET /compute/v2.1/servers/c709ad03-162e-408f-af2b-072b5c041a89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-702905148"}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:47:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:00 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-80539d37-e590-43f8-bcf0-56dc26cf36f9 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a/action" status: 202 len: 52 microversion: 2.87 time: 0.926776 Apr 19 15:48:00 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 80/239] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 15:47:59 2023] POST /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a/action => generated 52 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] [instance: a56bbb31-844d-4fe5-ac87-f1332893e262] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] HTTP exception thrown: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Request method failure captured: Apr 19 15:48:05 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 HTTP/1.1 Apr 19 15:48:05 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:48:05 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:48:05 user devstack@n-api.service[72849]: Connection: close Apr 19 15:48:05 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:48:05 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:48:05 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:48:05 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:48:05 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAvP6KOlr_AkHQ-6DIVUqJYOGzsUlTvES7xjTkC_C4NdLyMPzb6us4qQZ7QBXb1w7q_bLQevK2-U8HRNmtHidZTUNvBe29siLQOentgJnYxWjP8lupsQUBZVZPM2SokSrQ55peC2PYfKACCgBl1hsjI1cJITk3pliaPYtFPQVaara2M Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Project-Id: c81ec3d570254ba98de839dff3a4e38d Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c81ec3d570254ba98de839dff3a4e38d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c81ec3d570254ba98de839dff3a4e38d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c81ec3d570254ba98de839dff3a4e38d"}]}] Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Tenant-Id: c81ec3d570254ba98de839dff3a4e38d Apr 19 15:48:05 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1882279775 Apr 19 15:48:05 user devstack@n-api.service[72849]: X-User: tempest-VolumesAdminNegativeTest-1882279775-project-member Apr 19 15:48:05 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:48:05 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:48:05 user devstack@n-api.service[72849]: X-User-Id: ea2dcb51753d4099805e8589c93b8143 Apr 19 15:48:05 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesAdminNegativeTest-1882279775-project-member Apr 19 15:48:05 user devstack@n-api.service[72849]: method: > Apr 19 15:48:05 user devstack@n-api.service[72849]: exception: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. Apr 19 15:48:05 user devstack@n-api.service[72849]: action_args: {'id': 'a56bbb31-844d-4fe5-ac87-f1332893e262'} Apr 19 15:48:05 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. Apr 19 15:48:05 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:48:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Returning 404 to user: Instance a56bbb31-844d-4fe5-ac87-f1332893e262 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:48:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-9cd16e1f-1384-4285-acd4-2aabefce7f48 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262" status: 404 len: 111 microversion: 2.1 time: 0.214953 Apr 19 15:48:05 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:05 2023] GET /compute/v2.1/servers/a56bbb31-844d-4fe5-ac87-f1332893e262 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:48:05 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-cb21de02-6aed-4d91-a385-c9b328f26af2 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] Calling method '.version_select at 0x7f11e0a3a560>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:05 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-cb21de02-6aed-4d91-a385-c9b328f26af2 tempest-VolumesAdminNegativeTest-1882279775 tempest-VolumesAdminNegativeTest-1882279775-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817890597" status: 202 len: 0 microversion: 2.1 time: 0.024770 Apr 19 15:48:05 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:48:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817890597 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:05 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:06 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:06 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:06 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:06 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-759916a2-4665-4fa4-a3aa-e73648a1d30f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 200 len: 1690 microversion: 2.87 time: 0.254594 Apr 19 15:48:06 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 81/242] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:48:05 2023] GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=12 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:16 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:16 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5849045a-ae41-42d3-91ca-60c4910dcd13 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.522460 Apr 19 15:48:16 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:16 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:48:29 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:29 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:29 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-d2cede51-b6a5-4bc7-91d0-417d40b8e31b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Action: 'create', calling method: .version_select at 0x7f11e0a08dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-858596784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuAwwL9zpCK8PbMsEdIBALFAuQvjktYJzHiY8y/qB4WJNNtJixah2DjK7qiGFqiAFSH16ZV7dRbKLdLOBfjMMTw8hxvar+9VN/zBWEy0QeEbu0UqirUBXZsjkNDAk9Zjg=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:29 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-d2cede51-b6a5-4bc7-91d0-417d40b8e31b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:48:29 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-d2cede51-b6a5-4bc7-91d0-417d40b8e31b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for user 6bdea4f36e5f49e5a279f7273f5a66e6 and project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:48:29 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-d2cede51-b6a5-4bc7-91d0-417d40b8e31b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056664 Apr 19 15:48:29 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:48:29 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1341043490", "imageRef": "3fd34c67-3dfa-4185-b063-541d23fa5fcd", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-858596784", "networks": [{"uuid": "b8b96835-a471-4cde-adc1-5cf572ceb5ee"}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] validate_networks() for [('b8b96835-a471-4cde-adc1-5cf572ceb5ee', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for user 6bdea4f36e5f49e5a279f7273f5a66e6 and project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:48:29 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fd34c67-3dfa-4185-b063-541d23fa5fcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:48:30 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-65417df6-e981-4a06-99af-9ed9b81b313f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.673835 Apr 19 15:48:30 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:48:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:48:30 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-167b1366-8ee1-4d36-b43f-c4e39c544649 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:30 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-167b1366-8ee1-4d36-b43f-c4e39c544649 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:30 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:30 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:30 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-167b1366-8ee1-4d36-b43f-c4e39c544649 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:30 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-167b1366-8ee1-4d36-b43f-c4e39c544649 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 200 len: 1252 microversion: 2.1 time: 0.081864 Apr 19 15:48:30 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:30 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 1252 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:48:32 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:32 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:32 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] Creating event network-changed:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:48:32 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-37d6f243-d134-43f8-bc81-a675596a7b49 req-a04fb806-ed13-46e4-8918-5d19d5bfc90a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027889 Apr 19 15:48:32 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 84/247] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "name": "network-vif-plugged", "status": "completed", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:35 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] Creating event network-vif-plugged:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:48:35 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-2edd1cda-c7c9-4b77-b0a2-d281c299d9c1 req-97066797-123b-47bf-94d1-75d5ec37dfdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274425 Apr 19 15:48:35 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:48:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:35 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-673aff1f-0552-4694-934a-c96fb10db279 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '.version_select at 0x7f11e09a4040>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:35 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-673aff1f-0552-4694-934a-c96fb10db279 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6" status: 200 len: 1723 microversion: 2.1 time: 0.051968 Apr 19 15:48:35 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 15:48:35 2023] GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6 => generated 1723 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:48:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-42682856-f72a-4e33-8e5d-d45bef7dcc5d tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '.version_select at 0x7f11e0a3a320>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:35 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-42682856-f72a-4e33-8e5d-d45bef7dcc5d tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6" status: 200 len: 1723 microversion: 2.1 time: 0.052914 Apr 19 15:48:35 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 15:48:35 2023] GET /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6 => generated 1723 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:35 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:36 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c14c63019443df80be92da1b5761c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89db22a865434daa71b4b01f7bc063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-416eea15-2858-4ec9-a411-1e00eac45784 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 200 len: 1673 microversion: 2.1 time: 0.229782 Apr 19 15:48:36 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 84/251] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:35 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:48:37 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "name": "network-vif-plugged", "status": "completed", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:37 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] Creating event network-vif-plugged:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:48:37 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-49bbb588-b1d0-40a2-9451-8b747d37213c req-408d18fa-2df6-40a3-ae44-7f71f515c699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047008 Apr 19 15:48:37 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 83/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: aa34baf4-45e7-4aca-9bc7-fc36a5430ee1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] HTTP exception thrown: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Request method failure captured: Apr 19 15:48:45 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 HTTP/1.1 Apr 19 15:48:45 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:48:45 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:48:45 user devstack@n-api.service[72850]: Connection: close Apr 19 15:48:45 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:48:45 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:48:45 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:48:45 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:48:45 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAwJmoPx7WIMoHr2h0SSl6CEaNRe9CZswqB-ttD5-VM4S2cL1nubR_TtHZwn8bD5_lzS8UyUcEsobEcp9SUYYf4h1fMm20vaaZCGA_MpfuxuO2pe12Yj1F-Ky7NF0O5o1T5HWVPzBmb4SXuQCwxTbHVVppsWJRvTL1RCmOuUZ28neIg Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Project-Id: 792266f480534fb79345374f09042875 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/792266f480534fb79345374f09042875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/792266f480534fb79345374f09042875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/792266f480534fb79345374f09042875"}]}] Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Tenant-Id: 792266f480534fb79345374f09042875 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-User: tempest-ServerRescueNegativeTestJSON-1558863079-project-member Apr 19 15:48:45 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:48:45 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:48:45 user devstack@n-api.service[72850]: X-User-Id: ecb1979bbcb246b9b7b3c73f67af0b64 Apr 19 15:48:45 user devstack@n-api.service[72850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558863079-project-member Apr 19 15:48:45 user devstack@n-api.service[72850]: method: > Apr 19 15:48:45 user devstack@n-api.service[72850]: exception: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. Apr 19 15:48:45 user devstack@n-api.service[72850]: action_args: {'id': 'aa34baf4-45e7-4aca-9bc7-fc36a5430ee1'} Apr 19 15:48:45 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. Apr 19 15:48:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:48:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Returning 404 to user: Instance aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:48:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-48dedfce-9c2a-472d-919c-89e8a3a983da tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1" status: 404 len: 111 microversion: 2.1 time: 0.240884 Apr 19 15:48:45 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:45 2023] GET /compute/v2.1/servers/aa34baf4-45e7-4aca-9bc7-fc36a5430ee1 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:45 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:48:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-1aeb69fe-8b71-4556-b65b-117bfda90b09 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7" status: 204 len: 0 microversion: 2.1 time: 0.121476 Apr 19 15:48:45 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 85/254] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:48:45 2023] DELETE /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:46 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:46 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:46 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:46 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:46 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] Creating event network-vif-unplugged:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:48:46 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-ba9c69a8-e479-437f-9d95-72b79d19d0fe req-b260b44a-9815-4019-a3cd-a16e1c7732e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038484 Apr 19 15:48:46 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:46 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb1979bbcb246b9b7b3c73f67af0b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792266f480534fb79345374f09042875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:46 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1dcdfe03-35dc-47ea-b6b2-58433f2fff56 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7" status: 200 len: 1510 microversion: 2.1 time: 0.405753 Apr 19 15:48:46 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:45 2023] GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:48 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "name": "network-vif-plugged", "status": "completed", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}, {"server_uuid": "c941ea62-b596-4d62-a391-86e136251fb7", "name": "network-vif-deleted", "tag": "a2dc1ec8-3b87-4083-b901-ff715b5905fb"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:48:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:48:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:48:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:48:48 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Creating event network-vif-plugged:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:48:48 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] Creating event network-vif-deleted:a2dc1ec8-3b87-4083-b901-ff715b5905fb for instance c941ea62-b596-4d62-a391-86e136251fb7 on user Apr 19 15:48:48 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-962a4da3-f8a2-4c86-b642-5394bfdb384a req-99d142e2-ad58-4de1-8dc6-ae81aadd1876 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027519 Apr 19 15:48:48 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 88/257] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:48:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:48:48 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:48:48 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-021a63cd-5601-4077-9bf7-9cb894f7e84c tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1495 microversion: 2.1 time: 0.222289 Apr 19 15:48:48 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 86/258] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:48:48 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1495 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1450426777", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "054b9710-7933-4467-9e07-bc414d3de236", "destination_type": "volume"}], "networks": [{"uuid": "32c3e048-3dee-4ebc-b028-ef87b79a1668"}]}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=8 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=8 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] validate_networks() for [('32c3e048-3dee-4ebc-b028-ef87b79a1668', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Getting quotas for user 1f9882d12b0549c7ba8d6f3fe436e86c and project e73f4cb2217c40d8ba22e2548edf0408. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:49:06 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:49:06 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d86f4c0e-1a22-488c-a0a9-ddc5b6619f22 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.693176 Apr 19 15:49:06 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 85/259] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 15:49:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:07 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:07 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-8a0baee6-0e86-4897-a8df-9ea290a76a57 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced" status: 200 len: 1395 microversion: 2.87 time: 0.073478 Apr 19 15:49:07 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 89/260] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:49:07 2023] GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced => generated 1395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b964018-3334-485b-aa8a-a6058a00eced", "tag": "d0368910-5086-48e3-9960-18d77207b997"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] Creating event network-changed:d0368910-5086-48e3-9960-18d77207b997 for instance 5b964018-3334-485b-aa8a-a6058a00eced on user Apr 19 15:49:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-82ec1485-e81b-4da9-9002-9b59dadae332 req-526d8379-bf6b-4a97-9b11-d349bd75b9a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045625 Apr 19 15:49:09 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 87/261] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b964018-3334-485b-aa8a-a6058a00eced", "name": "network-vif-deleted", "tag": "d0368910-5086-48e3-9960-18d77207b997"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:14 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:14 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.compute.server_external_events [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] Unable to find a host for instance 5b964018-3334-485b-aa8a-a6058a00eced. Dropping event network-vif-deleted {{(pid=72849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 15:49:14 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-a90edf28-5dc1-4682-9a76-1cebdb27256b req-9797789f-88d5-4d4f-b48e-ecdac170ea35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028992 Apr 19 15:49:14 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 86/262] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:16 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:16 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-fed54732-b428-4d1b-a619-4c873e516771 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.210654 Apr 19 15:49:16 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:16 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:17 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-eee27a81-6c8c-4ccb-9faf-92d213c32590 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.213190 Apr 19 15:49:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:16 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:17 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e4fc43a5-60a3-4267-9e09-66e00e45178d tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.153263 Apr 19 15:49:17 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:17 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:20 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-438e596e-c56f-42e2-af2b-87b1b017e8b9 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 200 len: 1536 microversion: 2.1 time: 0.238367 Apr 19 15:49:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 91/266] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:20 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 1536 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] [instance: c941ea62-b596-4d62-a391-86e136251fb7] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=8 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] HTTP exception thrown: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Request method failure captured: Apr 19 15:49:36 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 HTTP/1.1 Apr 19 15:49:36 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:49:36 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:49:36 user devstack@n-api.service[72851]: Connection: close Apr 19 15:49:36 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:49:36 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:49:36 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:49:36 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:49:36 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAwJmoPx7WIMoHr2h0SSl6CEaNRe9CZswqB-ttD5-VM4S2cL1nubR_TtHZwn8bD5_lzS8UyUcEsobEcp9SUYYf4h1fMm20vaaZCGA_MpfuxuO2pe12Yj1F-Ky7NF0O5o1T5HWVPzBmb4SXuQCwxTbHVVppsWJRvTL1RCmOuUZ28neIg Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Project-Id: 792266f480534fb79345374f09042875 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/792266f480534fb79345374f09042875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/792266f480534fb79345374f09042875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/792266f480534fb79345374f09042875"}]}] Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Tenant-Id: 792266f480534fb79345374f09042875 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1558863079 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-User: tempest-ServerRescueNegativeTestJSON-1558863079-project-member Apr 19 15:49:36 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:49:36 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:49:36 user devstack@n-api.service[72851]: X-User-Id: ecb1979bbcb246b9b7b3c73f67af0b64 Apr 19 15:49:36 user devstack@n-api.service[72851]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1558863079-project-member Apr 19 15:49:36 user devstack@n-api.service[72851]: method: > Apr 19 15:49:36 user devstack@n-api.service[72851]: exception: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. Apr 19 15:49:36 user devstack@n-api.service[72851]: action_args: {'id': 'c941ea62-b596-4d62-a391-86e136251fb7'} Apr 19 15:49:36 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. Apr 19 15:49:36 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:49:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] Returning 404 to user: Instance c941ea62-b596-4d62-a391-86e136251fb7 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:49:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-52c6e80a-90ef-4fcc-9d56-3a698a56cb77 tempest-ServerRescueNegativeTestJSON-1558863079 tempest-ServerRescueNegativeTestJSON-1558863079-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7" status: 404 len: 111 microversion: 2.1 time: 0.045486 Apr 19 15:49:36 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 89/267] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:36 2023] GET /compute/v2.1/servers/c941ea62-b596-4d62-a391-86e136251fb7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=10 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:36 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c14c63019443df80be92da1b5761c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89db22a865434daa71b4b01f7bc063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:36 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-ce52e062-f120-45a2-94e6-bc51a5edfdee tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 200 len: 1673 microversion: 2.1 time: 0.380991 Apr 19 15:49:36 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:36 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 1673 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:38 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-08ceff46-1747-450a-a836-c8efc44683a7 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '.version_select at 0x7f11e0a39510>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:38 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=10 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:38 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=12 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:38 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-08ceff46-1747-450a-a836-c8efc44683a7 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6" status: 204 len: 0 microversion: 2.1 time: 0.198074 Apr 19 15:49:38 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 92/269] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:38 2023] DELETE /compute/v2.1/images/ecd3260d-e671-4558-a855-2471554727a6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:38 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:49:38 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-b20e3acb-cf6c-4bb4-b6dd-d9ac3228e7ba tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 204 len: 0 microversion: 2.1 time: 0.120825 Apr 19 15:49:38 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 90/270] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:49:38 2023] DELETE /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:38 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c14c63019443df80be92da1b5761c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89db22a865434daa71b4b01f7bc063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:38 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-92e3c9e4-a04a-4537-882a-57a3b0028e7c tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 200 len: 1679 microversion: 2.1 time: 0.204453 Apr 19 15:49:38 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 89/271] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:38 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:39 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "name": "network-vif-unplugged", "status": "completed", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] Creating event network-vif-unplugged:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:49:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-63ba33a4-0738-4279-8985-44d300c0d2e7 req-8f713a6d-02f3-478c-bef0-7690bb835095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031026 Apr 19 15:49:39 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 93/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:40 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "name": "network-vif-deleted", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:40 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] Creating event network-vif-deleted:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:49:40 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-e8b83469-e00d-40c1-8393-516fbd79ddd5 req-71e9739b-26fe-4e3e-8fa3-cb21b9bf45f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035264 Apr 19 15:49:40 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 91/273] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:41 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97a1a42-0143-43cc-bbc6-202403057d03", "name": "network-vif-plugged", "status": "completed", "tag": "ec7b698a-a68b-4f75-ac59-cc91533eba80"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:41 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:41 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:41 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:41 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] Creating event network-vif-plugged:ec7b698a-a68b-4f75-ac59-cc91533eba80 for instance c97a1a42-0143-43cc-bbc6-202403057d03 on user Apr 19 15:49:41 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-5d4680d9-1fae-48ab-b2e4-cbc763054892 req-2305d463-7655-4bc1-a032-56ead7444f4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026573 Apr 19 15:49:41 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 90/274] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:48 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7f32bd4f-88bb-4eb6-8256-342dda6a2f1e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Action: 'create', calling method: .version_select at 0x7f11e0a3ad40>, body: {"keypair": {"name": "tempest-keypair-1215325217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8ESVIzOY/LOlm8x5gBJGtLYmAC+uZU54kfsbBsmzrqSpHa9XKHJAikFdR73gEayY7H2N8R4sy63XGMMVCVHIkeATl+Hnx0vxhwknAc8dlzPN8wqZcCYDLWxch1b9Xxbg=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:48 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-7f32bd4f-88bb-4eb6-8256-342dda6a2f1e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:49:48 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-7f32bd4f-88bb-4eb6-8256-342dda6a2f1e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for user c38c4c3e9d6c4188a7fda942d147d9f4 and project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:49:48 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-7f32bd4f-88bb-4eb6-8256-342dda6a2f1e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206261 Apr 19 15:49:48 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 94/275] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:49:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:48 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:48 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-b458c123-2bb5-4711-98e6-2bd3a51085db tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1495 microversion: 2.1 time: 0.270178 Apr 19 15:49:48 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 92/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:48 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1495 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-413602998", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "89435102-530e-4931-a234-9a7fb5e878c4"}], "security_groups": [{"name": "tempest-securitygroup--346311880"}], "key_name": "tempest-keypair-1215325217", "user_data": "}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] validate_networks() for [('89435102-530e-4931-a234-9a7fb5e878c4', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for user c38c4c3e9d6c4188a7fda942d147d9f4 and project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:49:49 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:49:49 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-c58820be-60dd-4f36-9940-0077cf832727 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.583526 Apr 19 15:49:49 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 91/277] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:49:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:49:49 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:49:49 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2d6bd6ec-f924-471a-8564-000685aa30e2 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:49 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-2d6bd6ec-f924-471a-8564-000685aa30e2 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:50 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-2d6bd6ec-f924-471a-8564-000685aa30e2 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-2d6bd6ec-f924-471a-8564-000685aa30e2 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 200 len: 1231 microversion: 2.1 time: 0.082713 Apr 19 15:49:50 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 95/278] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:49:49 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 1231 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:49:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] Creating event network-changed:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:49:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-3086dbaf-9069-471a-ba47-a7b0ee6e4f32 req-6b608f81-36d9-43f4-abdc-892921c65fe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Apr 19 15:49:52 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:54 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "name": "network-vif-plugged", "status": "completed", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:54 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] Creating event network-vif-plugged:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:49:54 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-02b8b3f8-3fbd-4232-8193-7d7a77f10005 req-ef5f8edd-6b4b-435b-b40b-0f37e0454198 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040222 Apr 19 15:49:54 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 92/280] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:56 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "name": "network-vif-plugged", "status": "completed", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] Creating event network-vif-plugged:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:49:56 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-fd311aa9-afda-4269-8286-b792b0b11591 req-200d60b3-a2ad-46de-bab6-6f5b7b92795b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027752 Apr 19 15:49:56 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 96/281] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.objects.instance [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lazy-loading 'fault' on Instance uuid 5b964018-3334-485b-aa8a-a6058a00eced {{(pid=72851) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-49153c36-045c-401f-95b1-a5bd19622f5a tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced" status: 200 len: 1650 microversion: 2.87 time: 0.097383 Apr 19 15:49:57 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 94/282] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:49:57 2023] GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced => generated 1650 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Doing local delete in cell 1d1abc72-4a1e-46ad-b3ce-2880abea9047(cell1) {{(pid=72849) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72849]: WARNING nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] instance's host None is down, deleting from database Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] deallocate_for_instance() {{(pid=72849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Instance cache missing network info. {{(pid=72849) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Updating instance_info_cache with network_info: [] {{(pid=72849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=72849) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 15:49:57 user devstack@n-api.service[72849]: WARNING nova.compute.api [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 15:49:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-11debf62-7e0f-42a6-b920-d8fbf5cb5c41 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced" status: 204 len: 0 microversion: 2.87 time: 0.315763 Apr 19 15:49:57 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 93/283] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:49:57 2023] DELETE /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: 5b964018-3334-485b-aa8a-a6058a00eced] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] HTTP exception thrown: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Request method failure captured: Apr 19 15:49:57 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced HTTP/1.1 Apr 19 15:49:57 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:49:57 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:49:57 user devstack@n-api.service[72850]: Connection: close Apr 19 15:49:57 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:49:57 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:49:57 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:49:57 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:49:57 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvX9wkXYcBUkCUV5Z_aptFiHC4gHuenqpc3O-u8BieCcTD-HfeYkz6AW9DUOHsMNOh1CbJ0QnbyQ-TMDoC_R4aMf-YwS3ll6iTY-jEtX8W1vjNcpwGRXWTu4J5EZoA_44X_gQ9q1jQEiqwgqWsrkhV2uSX49Zm2n4rrh05tUm289bY Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Project-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e73f4cb2217c40d8ba22e2548edf0408"}]}] Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Tenant-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:49:57 user devstack@n-api.service[72850]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:49:57 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:49:57 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:49:57 user devstack@n-api.service[72850]: X-User-Id: 1f9882d12b0549c7ba8d6f3fe436e86c Apr 19 15:49:57 user devstack@n-api.service[72850]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:49:57 user devstack@n-api.service[72850]: method: > Apr 19 15:49:57 user devstack@n-api.service[72850]: exception: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. Apr 19 15:49:57 user devstack@n-api.service[72850]: action_args: {'id': '5b964018-3334-485b-aa8a-a6058a00eced'} Apr 19 15:49:57 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. Apr 19 15:49:57 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:49:57 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Returning 404 to user: Instance 5b964018-3334-485b-aa8a-a6058a00eced could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:49:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e522efe8-3795-4313-9eb8-073b35ce79cd tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced" status: 404 len: 111 microversion: 2.87 time: 0.031177 Apr 19 15:49:57 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 97/284] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:49:57 2023] GET /compute/v2.1/servers/5b964018-3334-485b-aa8a-a6058a00eced => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:49:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a6520d50-b72a-47b3-a4be-d1c7586d0a6c tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 204 len: 0 microversion: 2.87 time: 0.116688 Apr 19 15:49:57 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:49:57 2023] DELETE /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:58 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:58 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:58 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:49:58 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-c67371bd-8c9b-483f-90d5-cbee60af3e12 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 200 len: 1696 microversion: 2.87 time: 0.256943 Apr 19 15:49:58 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 94/286] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:49:57 2023] GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 1696 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:49:58 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "name": "network-vif-unplugged", "status": "completed", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:58 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] Creating event network-vif-unplugged:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:49:58 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-5c405761-6d5a-4c15-b952-d0fad76b5ee0 req-8455710b-e32d-4996-a646-eab858b3ab9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036317 Apr 19 15:49:58 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:49:59 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "name": "network-vif-deleted", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:49:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:49:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:49:59 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:49:59 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] Creating event network-vif-deleted:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:49:59 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-ba9f89ea-2420-453a-92ed-3a3567377a7a req-c6075f39-c6ae-4627-b8df-44ea26d5a152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Apr 19 15:49:59 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:49:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71270e1-566d-4ad3-b317-78f66fabee3a", "name": "network-vif-plugged", "status": "completed", "tag": "564c0cb8-e573-47a3-a955-0ca8041d774d"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:00 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] Creating event network-vif-plugged:564c0cb8-e573-47a3-a955-0ca8041d774d for instance d71270e1-566d-4ad3-b317-78f66fabee3a on user Apr 19 15:50:00 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-cf25854a-26df-4108-be62-6f41cd342d3e req-2c594798-cd09-49d4-8e10-dc0bc3820697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029454 Apr 19 15:50:00 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 95/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:19 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:19 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-b3759f0f-8bae-4bb8-9c0a-6b795cbd4158 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1657 microversion: 2.1 time: 0.232941 Apr 19 15:50:19 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 99/290] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:19 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1657 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:20 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:20 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-ef5787bc-435b-450b-8396-1185abb76b84 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 200 len: 1536 microversion: 2.1 time: 0.232138 Apr 19 15:50:20 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 97/291] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:20 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 1536 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Searching by: {'deleted': False, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136'} {{(pid=72849) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:20 user devstack@n-api.service[72849]: DEBUG nova.compute.multi_cell_list [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 15:50:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-471e7bfe-d0b7-4e20-82b2-057ddfefc6de tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.213043 Apr 19 15:50:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 96/292] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 15:50:20 2023] GET /compute/v2.1/servers => generated 341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:21 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:21 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-ccca5841-1191-454a-92c8-0597af4d2b89 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 200 len: 1536 microversion: 2.1 time: 0.228882 Apr 19 15:50:21 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:20 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 1536 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:22 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:50:22 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-27c868dc-9fe4-4e88-b363-78fd7b63ebf6 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 204 len: 0 microversion: 2.1 time: 0.147159 Apr 19 15:50:22 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:50:22 2023] DELETE /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:22 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:23 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:23 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a7e7e4a3-d2bf-47ec-a092-f95709fc860b tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 200 len: 1542 microversion: 2.1 time: 0.195034 Apr 19 15:50:23 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 97/295] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:22 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 1542 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:50:23 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "name": "network-vif-unplugged", "status": "completed", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:23 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:23 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:23 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:23 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] Creating event network-vif-unplugged:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:50:23 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-3721650b-a823-4b14-9c68-15104f2b3e86 req-103a8d47-626d-4c13-9baf-a045ff396c66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030539 Apr 19 15:50:23 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 101/296] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:24 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "name": "network-vif-deleted", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:24 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:24 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] Creating event network-vif-deleted:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:50:24 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-acf9a15c-f042-4d6c-bd36-d16398616b6d req-019c1e16-832e-483a-8ed4-c5cac5c113f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043823 Apr 19 15:50:24 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:25 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12d9663-98c2-417a-a065-ca97c40dc971", "name": "network-vif-plugged", "status": "completed", "tag": "eecf8d7f-3db9-4295-b49a-1efe62718d7f"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:25 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:25 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:25 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:25 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] Creating event network-vif-plugged:eecf8d7f-3db9-4295-b49a-1efe62718d7f for instance e12d9663-98c2-417a-a065-ca97c40dc971 on user Apr 19 15:50:25 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-56809236-da44-42fe-a6f9-b94c43519fc4 req-39f92055-81f3-4800-bf38-9cb781f06358 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Apr 19 15:50:25 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 98/298] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] [instance: c97a1a42-0143-43cc-bbc6-202403057d03] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:28 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:29 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] HTTP exception thrown: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. Apr 19 15:50:29 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Request method failure captured: Apr 19 15:50:29 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 HTTP/1.1 Apr 19 15:50:29 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:50:29 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:50:29 user devstack@n-api.service[72850]: Connection: close Apr 19 15:50:29 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:50:29 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:50:29 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:50:29 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:50:29 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAyvxUG1K5MfRyDaaItmnJdJU8PeT5-Pg77e_LZ-utuhBOm1Eyjw0xuZ1H1DZ-GLTAcMfSdFqAmxRFC0NChM2riQQl0tXgail6w_b1ztDBesJ1GUzhQPLK3aHSN6xfr_Bitziy5CJyO1JY4XEq_K__Kr9dZ2oTllORO5NCaxeNdhcJY Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Project-Id: 9e89db22a865434daa71b4b01f7bc063 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServerStableDeviceRescueTest-303999781 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e89db22a865434daa71b4b01f7bc063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e89db22a865434daa71b4b01f7bc063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e89db22a865434daa71b4b01f7bc063"}]}] Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Tenant: tempest-ServerStableDeviceRescueTest-303999781 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Tenant-Id: 9e89db22a865434daa71b4b01f7bc063 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-303999781 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-User: tempest-ServerStableDeviceRescueTest-303999781-project-member Apr 19 15:50:29 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:50:29 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:50:29 user devstack@n-api.service[72850]: X-User-Id: e0c14c63019443df80be92da1b5761c3 Apr 19 15:50:29 user devstack@n-api.service[72850]: X-User-Name: tempest-ServerStableDeviceRescueTest-303999781-project-member Apr 19 15:50:29 user devstack@n-api.service[72850]: method: > Apr 19 15:50:29 user devstack@n-api.service[72850]: exception: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. Apr 19 15:50:29 user devstack@n-api.service[72850]: action_args: {'id': 'c97a1a42-0143-43cc-bbc6-202403057d03'} Apr 19 15:50:29 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. Apr 19 15:50:29 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:29 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Returning 404 to user: Instance c97a1a42-0143-43cc-bbc6-202403057d03 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:50:29 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-7dcf9f6a-c4d3-4e1f-bfee-5c1c78719855 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03" status: 404 len: 111 microversion: 2.1 time: 0.028463 Apr 19 15:50:29 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 102/299] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:28 2023] GET /compute/v2.1/servers/c97a1a42-0143-43cc-bbc6-202403057d03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:50:29 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-9ad3a070-d6af-4d29-bff1-c2cb392165d4 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] Calling method '.version_select at 0x7f11e0932050>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:29 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-9ad3a070-d6af-4d29-bff1-c2cb392165d4 tempest-ServerStableDeviceRescueTest-303999781 tempest-ServerStableDeviceRescueTest-303999781-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816485432" status: 202 len: 0 microversion: 2.1 time: 0.023194 Apr 19 15:50:29 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:50:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816485432 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:50:34 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:34 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-f4226b06-fa91-412b-a90e-5163d7cb516c tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Action: 'create', calling method: .version_select at 0x7f11e093f130>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1053188837"}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:34 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-f4226b06-fa91-412b-a90e-5163d7cb516c tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.462129 Apr 19 15:50:34 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 99/301] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 19 15:50:34 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 15:50:34 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ac8aae6f-75c4-4c73-ba05-3f1b0717ffe2 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Calling method '.version_select at 0x7f11e0a39240>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:34 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-ac8aae6f-75c4-4c73-ba05-3f1b0717ffe2 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a" status: 200 len: 342 microversion: 2.1 time: 0.050545 Apr 19 15:50:34 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 103/302] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:50:34 2023] GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a => generated 342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:35 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:35 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-3eae5568-7d85-4a4d-ba59-7d86cb006e01 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Calling method '.version_select at 0x7f11e0984280>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:35 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-3eae5568-7d85-4a4d-ba59-7d86cb006e01 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a" status: 200 len: 342 microversion: 2.1 time: 0.099605 Apr 19 15:50:35 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 101/303] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:50:35 2023] GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a => generated 342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:35 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:35 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=16 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:35 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-2a1f4341-c4a8-40db-acc6-f1ff2655aea3 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Calling method '.version_select at 0x7f11e09a6f80>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:35 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-2a1f4341-c4a8-40db-acc6-f1ff2655aea3 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a" status: 202 len: 0 microversion: 2.1 time: 0.112306 Apr 19 15:50:35 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 100/304] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:50:35 2023] DELETE /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:50:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b345daf2-59c9-40ce-b37b-6cfd3d48f296 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Calling method '.version_select at 0x7f11e0a392d0>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:35 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-b345daf2-59c9-40ce-b37b-6cfd3d48f296 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] HTTP exception thrown: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. Apr 19 15:50:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b345daf2-59c9-40ce-b37b-6cfd3d48f296 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Request method failure captured: Apr 19 15:50:35 user devstack@n-api.service[72850]: request: GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a HTTP/1.1 Apr 19 15:50:35 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:50:35 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:50:35 user devstack@n-api.service[72850]: Connection: close Apr 19 15:50:35 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:50:35 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:50:35 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:50:35 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:50:35 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQA3KVIuoZPLc0k2zOtMPW15erb7dGiNr53plplTtvc0QsGPPXjaoLsLErYSgnw1-V2wL7TcB-FjedpOVPtbwbJBNviyFv5QPYnz8x-5Vxs33ZsLuPF-pkcrovtMJY2YGqPvLp4k3RBCY5dTE8vFjP8ekZAupJUtSplFrpAL-NRwkGaQ Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Project-Id: 782d47a4c76e4d97bca672199e4ad331 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-39960734 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/782d47a4c76e4d97bca672199e4ad331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/782d47a4c76e4d97bca672199e4ad331"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/782d47a4c76e4d97bca672199e4ad331"}]}] Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-39960734 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Tenant-Id: 782d47a4c76e4d97bca672199e4ad331 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-39960734 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-User: tempest-VolumesSnapshotsTestJSON-39960734-project-member Apr 19 15:50:35 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:50:35 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:50:35 user devstack@n-api.service[72850]: X-User-Id: a4db97b51b4a47ddbbe2945c1a18e931 Apr 19 15:50:35 user devstack@n-api.service[72850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-39960734-project-member Apr 19 15:50:35 user devstack@n-api.service[72850]: method: Apr 19 15:50:35 user devstack@n-api.service[72850]: exception: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. Apr 19 15:50:35 user devstack@n-api.service[72850]: action_args: {'id': '78a4b8ad-6629-4eca-a1b0-fdefb02ab32a'} Apr 19 15:50:35 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. (HTTP 404) (Request-ID: req-bcdf4644-4725-4732-8dd9-ac4955b32757) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. Apr 19 15:50:35 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:50:35 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b345daf2-59c9-40ce-b37b-6cfd3d48f296 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] Returning 404 to user: Volume 78a4b8ad-6629-4eca-a1b0-fdefb02ab32a could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:50:35 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-b345daf2-59c9-40ce-b37b-6cfd3d48f296 tempest-VolumesSnapshotsTestJSON-39960734 tempest-VolumesSnapshotsTestJSON-39960734-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a" status: 404 len: 109 microversion: 2.1 time: 0.035763 Apr 19 15:50:35 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 104/305] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 15:50:35 2023] GET /compute/v2.1/os-volumes/78a4b8ad-6629-4eca-a1b0-fdefb02ab32a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:40 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:40 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-5fc6c913-2396-4775-9088-142b02105503 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 200 len: 1536 microversion: 2.1 time: 0.241993 Apr 19 15:50:40 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:40 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 1536 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1377117124", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "networks": [{"uuid": "b8978b6a-b01a-4083-9dae-a54bffae6bf3"}]}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] validate_networks() for [('b8978b6a-b01a-4083-9dae-a54bffae6bf3', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Getting quotas for project 2463ead51cd7410c860d488559676e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Getting quotas for user 6df8741ec8d84d84a72fd76c9ebf729f and project 2463ead51cd7410c860d488559676e4f. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:50:45 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:50:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-016edc47-e407-4b6c-87b0-5b6d892ebaa4 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.636680 Apr 19 15:50:45 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 101/307] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:50:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:50:45 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=8 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:45 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=16 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:50:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-23eabcfc-82a9-4b27-84b2-bea7584e03d8 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:45 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-23eabcfc-82a9-4b27-84b2-bea7584e03d8 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:45 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-23eabcfc-82a9-4b27-84b2-bea7584e03d8 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df8741ec8d84d84a72fd76c9ebf729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463ead51cd7410c860d488559676e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-23eabcfc-82a9-4b27-84b2-bea7584e03d8 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da" status: 200 len: 1208 microversion: 2.1 time: 0.095606 Apr 19 15:50:45 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 105/308] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:45 2023] GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d434150b-9050-451d-999f-32a4103017da", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] Creating event network-changed:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:50:48 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-9a8c44c2-0180-4b4d-b169-d2faf48de3a1 req-025c0233-e31e-4f28-a7fa-1dcedecd49d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028495 Apr 19 15:50:48 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 103/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d71270e1-566d-4ad3-b317-78f66fabee3a] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] HTTP exception thrown: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Request method failure captured: Apr 19 15:50:48 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a HTTP/1.1 Apr 19 15:50:48 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:50:48 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:50:48 user devstack@n-api.service[72849]: Connection: close Apr 19 15:50:48 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:50:48 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:50:48 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:50:48 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:50:48 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAvX9wkXYcBUkCUV5Z_aptFiHC4gHuenqpc3O-u8BieCcTD-HfeYkz6AW9DUOHsMNOh1CbJ0QnbyQ-TMDoC_R4aMf-YwS3ll6iTY-jEtX8W1vjNcpwGRXWTu4J5EZoA_44X_gQ9q1jQEiqwgqWsrkhV2uSX49Zm2n4rrh05tUm289bY Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Project-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e73f4cb2217c40d8ba22e2548edf0408"}]}] Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Tenant-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:50:48 user devstack@n-api.service[72849]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:50:48 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:50:48 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:50:48 user devstack@n-api.service[72849]: X-User-Id: 1f9882d12b0549c7ba8d6f3fe436e86c Apr 19 15:50:48 user devstack@n-api.service[72849]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:50:48 user devstack@n-api.service[72849]: method: > Apr 19 15:50:48 user devstack@n-api.service[72849]: exception: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. Apr 19 15:50:48 user devstack@n-api.service[72849]: action_args: {'id': 'd71270e1-566d-4ad3-b317-78f66fabee3a'} Apr 19 15:50:48 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. Apr 19 15:50:48 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:50:48 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Returning 404 to user: Instance d71270e1-566d-4ad3-b317-78f66fabee3a could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:50:48 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-cf711fe6-f8b5-4e54-bf5d-b2c22b06a082 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a" status: 404 len: 111 microversion: 2.87 time: 0.033711 Apr 19 15:50:48 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 102/310] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:50:48 2023] GET /compute/v2.1/servers/d71270e1-566d-4ad3-b317-78f66fabee3a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:50:48 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-b4adcbbc-0d9e-4fd0-ae1c-52ed44960065 tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 204 len: 0 microversion: 2.87 time: 0.126220 Apr 19 15:50:48 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 106/311] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 15:50:48 2023] DELETE /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:48 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:49 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "name": "network-vif-unplugged", "status": "completed", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:49 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:49 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] Creating event network-vif-unplugged:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:50:49 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-1a7934ba-26da-4d55-b616-23dc72d14cea req-357d1d07-dcb1-4f6c-80dc-4f6f082434b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033108 Apr 19 15:50:49 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 103/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:49 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:49 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:49 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f9882d12b0549c7ba8d6f3fe436e86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73f4cb2217c40d8ba22e2548edf0408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:49 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-5f3a87ca-6b6b-4e4e-8edc-f3d6a4c41c6f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 200 len: 1696 microversion: 2.87 time: 0.740839 Apr 19 15:50:49 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:50:48 2023] GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 1696 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 15:50:50 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "name": "network-vif-deleted", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] Creating event network-vif-deleted:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:50:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-8be7f8cc-bc9f-48e7-ac02-66be0c19fc9e req-a583b9d0-5db7-4c7f-8401-c319055dfdd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051534 Apr 19 15:50:50 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 107/314] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:50 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:50:50 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-aa271b06-89ab-4ccd-9a3e-7ef9dae7ab5f tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1495 microversion: 2.1 time: 0.255559 Apr 19 15:50:50 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:50:50 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1495 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:50:50 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:50 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:50:50 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-6c66ca5c-f7aa-40f6-8c89-a8ae5f32e7cb req-8032d954-63f9-4709-b93a-009d2736e1e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041660 Apr 19 15:50:50 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:51 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bffd3c-7acb-4279-8c7e-f2308fb51c72", "name": "network-vif-plugged", "status": "completed", "tag": "4ec379ec-9333-4fc9-a02c-0c54bccf6522"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:51 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] Creating event network-vif-plugged:4ec379ec-9333-4fc9-a02c-0c54bccf6522 for instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 on user Apr 19 15:50:51 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-f370db31-0226-4186-869b-f52f52f6ec4d req-7ece224d-aac7-4e6d-890d-db0bc27cd097 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 Apr 19 15:50:51 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 108/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:50:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:50:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:50:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:50:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:50:52 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:50:52 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-90043113-8486-4003-91bd-ae7c75e77eb2 req-839e18a7-3ebc-471c-91da-daab3ba7b35c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032391 Apr 19 15:50:52 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 105/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: e12d9663-98c2-417a-a065-ca97c40dc971] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=10 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=16 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] HTTP exception thrown: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Request method failure captured: Apr 19 15:51:13 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 HTTP/1.1 Apr 19 15:51:13 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:51:13 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:51:13 user devstack@n-api.service[72851]: Connection: close Apr 19 15:51:13 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:51:13 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:51:13 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:51:13 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:51:13 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA1Eju9kFkEy5TpSia28nAua1TZ0yAGp0EasBxk2jeCQZQUXPrwmy4d5K0-llmRzZJTGtaMxNeT0_hcN8N6EFsaX7-dOh92crHE6ce_gIiqwRmfbYxIc83DfDMhoBLYyJ-SBl1Mm7JnJp-DFdOFhRTNi2x36sa7fUR_8P_qVUWsRpDQ Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Project-Id: 2f7533c8ab8a45baa3d4bf8373fc0136 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Project-Name: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f7533c8ab8a45baa3d4bf8373fc0136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f7533c8ab8a45baa3d4bf8373fc0136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f7533c8ab8a45baa3d4bf8373fc0136"}]}] Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Tenant: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Tenant-Id: 2f7533c8ab8a45baa3d4bf8373fc0136 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-User: tempest-TestMinimumBasicScenario-591841759-project-member Apr 19 15:51:13 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:51:13 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:51:13 user devstack@n-api.service[72851]: X-User-Id: 6bdea4f36e5f49e5a279f7273f5a66e6 Apr 19 15:51:13 user devstack@n-api.service[72851]: X-User-Name: tempest-TestMinimumBasicScenario-591841759-project-member Apr 19 15:51:13 user devstack@n-api.service[72851]: method: > Apr 19 15:51:13 user devstack@n-api.service[72851]: exception: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. Apr 19 15:51:13 user devstack@n-api.service[72851]: action_args: {'id': 'e12d9663-98c2-417a-a065-ca97c40dc971'} Apr 19 15:51:13 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. Apr 19 15:51:13 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:51:13 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Returning 404 to user: Instance e12d9663-98c2-417a-a065-ca97c40dc971 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:51:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-80eef3c4-74ad-4380-a3cb-0a128499905c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971" status: 404 len: 111 microversion: 2.1 time: 0.032976 Apr 19 15:51:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:13 2023] GET /compute/v2.1/servers/e12d9663-98c2-417a-a065-ca97c40dc971 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 15:51:13 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:13 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:13 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:13 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-312a23ff-3927-49ed-b9f9-506ef087b75c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '.version_select at 0x7f11e0aa68c0>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:13 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-312a23ff-3927-49ed-b9f9-506ef087b75c tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-858596784" status: 202 len: 0 microversion: 2.1 time: 0.036269 Apr 19 15:51:13 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 109/320] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 19 15:51:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-858596784 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=14 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-a181322c-8793-4308-a680-a036d99e72f8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Action: 'create', calling method: .version_select at 0x7f11e09a4ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1547822728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+Dv6lKgDgeMtAY55ntcAqV+J8rGQE0N84+Lh75xftRa1Op+gDH1XJhrDIREdF+T5NSvilsloutRJCFbF/y0ZkPGI2N5Dsimlm6x9xgVqISEsLKqgaa//ALkjC/VByTxA=="}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-a181322c-8793-4308-a680-a036d99e72f8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:51:15 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-a181322c-8793-4308-a680-a036d99e72f8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for user 6bdea4f36e5f49e5a279f7273f5a66e6 and project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:51:15 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-a181322c-8793-4308-a680-a036d99e72f8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051458 Apr 19 15:51:15 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 106/321] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:51:15 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-642335254", "imageRef": "19401dca-91ff-4159-974c-80498ded65de", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1547822728", "networks": [{"uuid": "b8b96835-a471-4cde-adc1-5cf572ceb5ee"}]}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] validate_networks() for [('b8b96835-a471-4cde-adc1-5cf572ceb5ee', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Getting quotas for user 6bdea4f36e5f49e5a279f7273f5a66e6 and project 2f7533c8ab8a45baa3d4bf8373fc0136. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:51:15 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19401dca-91ff-4159-974c-80498ded65de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:51:15 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-bb6db813-36f4-4cd4-8de8-fb7c6b8119ca tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.559780 Apr 19 15:51:15 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 107/322] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:51:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:51:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-030af1ad-b92c-460e-b51f-2a3337bcff5f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:15 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-030af1ad-b92c-460e-b51f-2a3337bcff5f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:16 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-030af1ad-b92c-460e-b51f-2a3337bcff5f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:51:16 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-030af1ad-b92c-460e-b51f-2a3337bcff5f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 200 len: 1252 microversion: 2.1 time: 0.061544 Apr 19 15:51:16 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 110/323] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:15 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 1252 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:51:19 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:19 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] Creating event network-changed:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:51:19 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-9af7f95d-adac-4ed4-a696-6d657f40affa req-f04876f2-a7cc-4875-99ca-871a295370c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027515 Apr 19 15:51:19 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 107/324] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:19 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:51:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a937f704-01bf-4950-9d7b-309b7c0a9562 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 204 len: 0 microversion: 2.1 time: 0.115089 Apr 19 15:51:19 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 108/325] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:51:19 2023] DELETE /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:20 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90cfd0897fe49a6a04e8c1a26cb58ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fceb0e89f74207b2f4ec4e4bf39e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:51:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-23908800-d135-4dc5-be00-8be2b32d4653 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 200 len: 1663 microversion: 2.1 time: 0.289777 Apr 19 15:51:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 111/326] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:19 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 1663 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:51:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "name": "network-vif-unplugged", "status": "completed", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] Creating event network-vif-unplugged:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:51:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-6e86dd95-e604-4c10-8c4a-c007be9d9f6d req-ed21bfa6-d79a-4ce2-b9d5-b7fbabeed931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029280 Apr 19 15:51:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:21 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "name": "network-vif-plugged", "status": "completed", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:21 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] Creating event network-vif-plugged:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:51:21 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-6356ae24-97f1-44e6-98c0-b5d9d08fd4a9 req-ea77b69c-4e9a-46db-b201-22ea8d4d55fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036518 Apr 19 15:51:21 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 109/328] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:22 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "name": "network-vif-plugged", "status": "completed", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:22 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:22 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:22 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:22 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] Creating event network-vif-plugged:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:51:22 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-66ca0360-26f7-4c96-95ad-e80497af216f req-fd45eda8-b956-48c6-b5fc-bb5d542e63dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Apr 19 15:51:22 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 112/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:23 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "name": "network-vif-plugged", "status": "completed", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}, {"server_uuid": "efcf324c-6f0c-49cc-8475-da873dc15243", "name": "network-vif-deleted", "tag": "68602407-0091-4c85-992d-4dd50391d256"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:23 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:23 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:23 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:23 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Creating event network-vif-plugged:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:51:23 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] Creating event network-vif-deleted:68602407-0091-4c85-992d-4dd50391d256 for instance efcf324c-6f0c-49cc-8475-da873dc15243 on user Apr 19 15:51:23 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-9f21e6a2-42aa-43b0-88ea-3cc3b60175fe req-be1be9e2-82ee-4793-929f-6b10c78cf205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034802 Apr 19 15:51:23 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:35 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:36 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df8741ec8d84d84a72fd76c9ebf729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463ead51cd7410c860d488559676e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:51:36 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-14dbd0c1-3f52-4aa5-bb80-1b6c233aa191 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da" status: 200 len: 1485 microversion: 2.1 time: 0.232352 Apr 19 15:51:36 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 110/331] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:35 2023] GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da => generated 1485 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=8 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] [instance: d0bffd3c-7acb-4279-8c7e-f2308fb51c72] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] HTTP exception thrown: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Request method failure captured: Apr 19 15:51:39 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 HTTP/1.1 Apr 19 15:51:39 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:51:39 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:51:39 user devstack@n-api.service[72850]: Connection: close Apr 19 15:51:39 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:51:39 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:51:39 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:51:39 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:51:39 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAvX9wkXYcBUkCUV5Z_aptFiHC4gHuenqpc3O-u8BieCcTD-HfeYkz6AW9DUOHsMNOh1CbJ0QnbyQ-TMDoC_R4aMf-YwS3ll6iTY-jEtX8W1vjNcpwGRXWTu4J5EZoA_44X_gQ9q1jQEiqwgqWsrkhV2uSX49Zm2n4rrh05tUm289bY Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Project-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e73f4cb2217c40d8ba22e2548edf0408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e73f4cb2217c40d8ba22e2548edf0408"}]}] Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Tenant-Id: e73f4cb2217c40d8ba22e2548edf0408 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537 Apr 19 15:51:39 user devstack@n-api.service[72850]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:51:39 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:51:39 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:51:39 user devstack@n-api.service[72850]: X-User-Id: 1f9882d12b0549c7ba8d6f3fe436e86c Apr 19 15:51:39 user devstack@n-api.service[72850]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member Apr 19 15:51:39 user devstack@n-api.service[72850]: method: > Apr 19 15:51:39 user devstack@n-api.service[72850]: exception: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. Apr 19 15:51:39 user devstack@n-api.service[72850]: action_args: {'id': 'd0bffd3c-7acb-4279-8c7e-f2308fb51c72'} Apr 19 15:51:39 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. Apr 19 15:51:39 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:39 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] Returning 404 to user: Instance d0bffd3c-7acb-4279-8c7e-f2308fb51c72 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:51:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-56825897-5a7a-4ce6-8a50-a2e2c091b37f tempest-ServerBootFromVolumeStableRescueTest-1851711537 tempest-ServerBootFromVolumeStableRescueTest-1851711537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72" status: 404 len: 111 microversion: 2.87 time: 0.034170 Apr 19 15:51:39 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 113/332] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 15:51:39 2023] GET /compute/v2.1/servers/d0bffd3c-7acb-4279-8c7e-f2308fb51c72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-eea15407-6f88-43d3-a275-3047975f7759 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.204742 Apr 19 15:51:40 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 110/333] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:51:40 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1/os-interface => generated 282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:41 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:41 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] Creating event network-changed:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:51:41 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-18cdd88f-2598-4b1e-8fef-1c51a11defb5 req-2ce9c1b7-ea57-4358-b68d-b039de6593bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030680 Apr 19 15:51:41 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 111/334] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:41 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-5e8cc6df-292a-443a-89ad-17c96affa634 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1/ips" status: 200 len: 104 microversion: 2.1 time: 0.042115 Apr 19 15:51:41 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 114/335] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:51:41 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1/ips => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:43 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:51:43 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e85db22e-bb2f-4384-a006-7feea4d8f304 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 204 len: 0 microversion: 2.1 time: 0.114195 Apr 19 15:51:43 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 111/336] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:51:43 2023] DELETE /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:43 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:51:43 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-7e443b17-e901-4460-a059-28365632b2be tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 200 len: 1660 microversion: 2.1 time: 0.185206 Apr 19 15:51:43 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 112/337] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:43 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 1660 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:51:43 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "name": "network-vif-unplugged", "status": "completed", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:43 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:43 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] Creating event network-vif-unplugged:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:51:43 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-4b686a00-b05f-4ee6-9ab2-2e84158ee63b req-3ceecaf0-cb3e-4997-bc1d-d37af79d1290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028716 Apr 19 15:51:43 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 115/338] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:44 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "name": "network-vif-deleted", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:44 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:44 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] Creating event network-vif-deleted:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:51:44 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-e1982b51-cbdf-4106-a287-0456a66147aa req-78e06a02-a8b6-4afd-81a5-d1d6d37a596a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Apr 19 15:51:44 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:45 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27332dd7-9cf0-4787-b615-72d4272f7fb1", "name": "network-vif-plugged", "status": "completed", "tag": "a170c2fb-373e-4f79-850a-2b7de826a866"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] Creating event network-vif-plugged:a170c2fb-373e-4f79-850a-2b7de826a866 for instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 on user Apr 19 15:51:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-7861839d-2ca2-47ef-b7b8-1dd94d828b3e req-80a06263-7258-4712-965a-b74a0165ddd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028148 Apr 19 15:51:45 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] HTTP exception thrown: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Request method failure captured: Apr 19 15:51:50 user devstack@n-api.service[72850]: request: DELETE /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 HTTP/1.1 Apr 19 15:51:50 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:51:50 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:51:50 user devstack@n-api.service[72850]: Connection: close Apr 19 15:51:50 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:51:50 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:51:50 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:51:50 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:51:50 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAwPzsTq0a2Gf6cQJxPRTNhjpdeNPpmnFeKUTW-_Q6QQnk7YR5uLXzi7-mQFUknr9W64CFu3pp-7pid9_1iv02RQC1ab-ynOf7n00qeuvfdaD3sUz5NwJLHi7h1is66_RAV5ThtLfqiZ_LzPfvlzPwnnSmiVjW1RXu5Vg4WTOL9qVnQ Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Project-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d7a7d854e5047be8182fcc02f68c125"}]}] Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Tenant: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Tenant-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72850]: X-User: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:51:50 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:51:50 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:51:50 user devstack@n-api.service[72850]: X-User-Id: f4f54b80641e48dfbc83ba21c1decb9c Apr 19 15:51:50 user devstack@n-api.service[72850]: X-User-Name: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:51:50 user devstack@n-api.service[72850]: method: > Apr 19 15:51:50 user devstack@n-api.service[72850]: exception: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72850]: action_args: {'id': '16da2a2d-21a2-44b7-906a-29900a51ccb3'} Apr 19 15:51:50 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Returning 404 to user: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:51:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-78dbbcf2-fc46-4ffe-8d64-d43c1cce3735 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 404 len: 111 microversion: 2.1 time: 0.031080 Apr 19 15:51:50 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 116/341] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:51:50 2023] DELETE /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 16da2a2d-21a2-44b7-906a-29900a51ccb3] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] HTTP exception thrown: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Request method failure captured: Apr 19 15:51:50 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 HTTP/1.1 Apr 19 15:51:50 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:51:50 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:51:50 user devstack@n-api.service[72849]: Connection: close Apr 19 15:51:50 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:51:50 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:51:50 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:51:50 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:51:50 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQAwPzsTq0a2Gf6cQJxPRTNhjpdeNPpmnFeKUTW-_Q6QQnk7YR5uLXzi7-mQFUknr9W64CFu3pp-7pid9_1iv02RQC1ab-ynOf7n00qeuvfdaD3sUz5NwJLHi7h1is66_RAV5ThtLfqiZ_LzPfvlzPwnnSmiVjW1RXu5Vg4WTOL9qVnQ Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Project-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Project-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d7a7d854e5047be8182fcc02f68c125"}]}] Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Tenant: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Tenant-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:51:50 user devstack@n-api.service[72849]: X-User: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:51:50 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:51:50 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:51:50 user devstack@n-api.service[72849]: X-User-Id: f4f54b80641e48dfbc83ba21c1decb9c Apr 19 15:51:50 user devstack@n-api.service[72849]: X-User-Name: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:51:50 user devstack@n-api.service[72849]: method: > Apr 19 15:51:50 user devstack@n-api.service[72849]: exception: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72849]: action_args: {'id': '16da2a2d-21a2-44b7-906a-29900a51ccb3'} Apr 19 15:51:50 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. Apr 19 15:51:50 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:51:50 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Returning 404 to user: Instance 16da2a2d-21a2-44b7-906a-29900a51ccb3 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:51:50 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-3c791d00-54ca-4c90-8374-cc4c5f07e6c3 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3" status: 404 len: 111 microversion: 2.1 time: 0.030009 Apr 19 15:51:50 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 113/342] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:50 2023] GET /compute/v2.1/servers/16da2a2d-21a2-44b7-906a-29900a51ccb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:50 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:51:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-3c92651a-29ba-479e-b0d3-0164277a1cbb tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 204 len: 0 microversion: 2.1 time: 0.118677 Apr 19 15:51:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:51:50 2023] DELETE /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:51 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "name": "network-vif-unplugged", "status": "completed", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:51 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] Creating event network-vif-unplugged:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:51:51 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-757049a9-fa4d-4c2d-86cf-b5b64d5b1cc6 req-5ee56166-7826-4d2a-9bae-123d187726b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027361 Apr 19 15:51:51 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:51:51 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f54b80641e48dfbc83ba21c1decb9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7a7d854e5047be8182fcc02f68c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:51:51 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-4944b0d5-be5f-4844-959c-1d2957531546 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 200 len: 1501 microversion: 2.1 time: 0.286431 Apr 19 15:51:51 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:51:51 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 1501 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:51:52 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "name": "network-vif-deleted", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:52 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] Creating event network-vif-deleted:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:51:52 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-fd590995-e325-4f5b-8320-fdb940288e5a req-21abb432-cebb-4175-8279-984bd7db4b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031363 Apr 19 15:51:52 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 115/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:51:53 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761c0e45-abe5-4412-a433-c97f7d8212f1", "name": "network-vif-plugged", "status": "completed", "tag": "4328a781-26ae-4e41-a7e0-979c3e4b8743"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:51:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:51:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:51:53 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:51:53 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] Creating event network-vif-plugged:4328a781-26ae-4e41-a7e0-979c3e4b8743 for instance 761c0e45-abe5-4412-a433-c97f7d8212f1 on user Apr 19 15:51:53 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-2d1efc7b-1a5b-4a45-993b-5159af92bf9b req-6bbb2301-d404-4376-81c1-1048c4f5f071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027711 Apr 19 15:51:53 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=10 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=16 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:06 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:52:06 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f3292d89-85e8-41d7-a688-fee55210db5e tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 200 len: 1536 microversion: 2.1 time: 0.794684 Apr 19 15:52:06 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 118/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:06 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 1536 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] [instance: efcf324c-6f0c-49cc-8475-da873dc15243] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] HTTP exception thrown: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Request method failure captured: Apr 19 15:52:10 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 HTTP/1.1 Apr 19 15:52:10 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:52:10 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:52:10 user devstack@n-api.service[72851]: Connection: close Apr 19 15:52:10 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:52:10 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:52:10 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:52:10 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:52:10 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQAvYtqlJq1H85qO-4PHWGd6UJx1GnGvl-ORkNV7qRPF8saJnYqW5vC3lRz1D2kgHxBSMHbpwoeYHGYAR1gIm_ezMEEGsq87bAjuOO3jeDRPm7fl6Dt91nchuIPYoNoCk_1jjo06bOz6NaC4-fLLRAFf2tX-tKsT2j6CsoNilEU0alKM Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Project-Id: c7fceb0e89f74207b2f4ec4e4bf39e03 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Project-Name: tempest-ServerActionsTestJSON-2050956138 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7fceb0e89f74207b2f4ec4e4bf39e03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c7fceb0e89f74207b2f4ec4e4bf39e03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c7fceb0e89f74207b2f4ec4e4bf39e03"}]}] Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Tenant: tempest-ServerActionsTestJSON-2050956138 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Tenant-Id: c7fceb0e89f74207b2f4ec4e4bf39e03 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-ServerActionsTestJSON-2050956138 Apr 19 15:52:10 user devstack@n-api.service[72851]: X-User: tempest-ServerActionsTestJSON-2050956138-project-member Apr 19 15:52:10 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:52:10 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:52:10 user devstack@n-api.service[72851]: X-User-Id: f90cfd0897fe49a6a04e8c1a26cb58ff Apr 19 15:52:10 user devstack@n-api.service[72851]: X-User-Name: tempest-ServerActionsTestJSON-2050956138-project-member Apr 19 15:52:10 user devstack@n-api.service[72851]: method: > Apr 19 15:52:10 user devstack@n-api.service[72851]: exception: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. Apr 19 15:52:10 user devstack@n-api.service[72851]: action_args: {'id': 'efcf324c-6f0c-49cc-8475-da873dc15243'} Apr 19 15:52:10 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. Apr 19 15:52:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:52:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Returning 404 to user: Instance efcf324c-6f0c-49cc-8475-da873dc15243 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:52:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-6107a33a-53b2-492c-9d0f-312d84ac05e6 tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243" status: 404 len: 111 microversion: 2.1 time: 0.038603 Apr 19 15:52:10 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 116/349] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:10 2023] GET /compute/v2.1/servers/efcf324c-6f0c-49cc-8475-da873dc15243 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 15:52:10 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:10 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:10 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ac028ba7-3eb1-48fe-8bab-c3bde1a3dc2c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] Calling method '.version_select at 0x7f11e09a7ac0>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-ac028ba7-3eb1-48fe-8bab-c3bde1a3dc2c tempest-ServerActionsTestJSON-2050956138 tempest-ServerActionsTestJSON-2050956138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601838696" status: 202 len: 0 microversion: 2.1 time: 0.028439 Apr 19 15:52:10 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 15:52:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601838696 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 15:52:14 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-59439775-6188-419a-ba71-622ecb7fe55c tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] Action: 'create', calling method: .version_select at 0x7f11e0a3b010>, body: {"keypair": {"name": "tempest-TestStampPattern-1233209828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbCTQVVdTBErcjMJvgw/9OM2E7rU0f+fijM5x05fOrxIB/ZppZ4KVoMr5Vb1xcSkuoXRwVomux7dA/lAfpe2cgeZWv3DIRiaB8PCiy61BbGjYl+iz6i6rGWg8c+tvf3MQ=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:14 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-59439775-6188-419a-ba71-622ecb7fe55c tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] Getting quotas for project b61fb4c59e784f6590dcc75e65b1c2d7. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:52:14 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-59439775-6188-419a-ba71-622ecb7fe55c tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] Getting quotas for user 48ba990beba64c0589ddaeba8a48e4e8 and project b61fb4c59e784f6590dcc75e65b1c2d7. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:52:14 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-59439775-6188-419a-ba71-622ecb7fe55c tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.275170 Apr 19 15:52:14 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 119/351] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:52:14 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:17 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-202e8c83-954b-44e1-abe1-531ec2793957 tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] Calling method '.version_select at 0x7f11e0931b40>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-202e8c83-954b-44e1-abe1-531ec2793957 tempest-TestStampPattern-621026740 tempest-TestStampPattern-621026740-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1233209828" status: 202 len: 0 microversion: 2.1 time: 0.035102 Apr 19 15:52:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 117/352] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:52:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1233209828 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 15:52:23 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:23 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-bc67f23a-783b-48fc-a376-bce49ed0d17f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: .version_select at 0x7f11e070ca60>, body: {"keypair": {"name": "tempest-keypair-1965047516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRKocbHVyktSizcygUQ5DBxFzRoAr9jDDSHOyT1kK8D33Ykyalp8CeKC9l60qom+D1XurkHE19Yu2Of+P+DtQWJVV+UXZQPykMY2Og0aR5cOXk42rDe8jX2EsFwz3JhMA=="}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:23 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-bc67f23a-783b-48fc-a376-bce49ed0d17f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:52:23 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-bc67f23a-783b-48fc-a376-bce49ed0d17f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:52:23 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-bc67f23a-783b-48fc-a376-bce49ed0d17f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148999 Apr 19 15:52:23 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 117/353] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:52:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:25 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:25 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:25 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:25 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-56896301", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7"}], "security_groups": [{"name": "tempest-securitygroup--1987367291"}], "key_name": "tempest-keypair-1965047516", "user_data": "}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:25 user devstack@n-api.service[72850]: DEBUG nova.network.neutron [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] validate_networks() for [('d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7', None, None, None, None, None)] {{(pid=72850) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image limits 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image pref 0:0:0 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.virt.hardware [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Going to run 1 instances... {{(pid=72850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:52:26 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:52:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-2ce12c54-e0c3-4a47-a907-1fc181517a34 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.028113 Apr 19 15:52:26 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 120/354] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:52:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:52:26 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:26 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a2cd253c-8540-48be-8da3-e7fe7807d65c tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:26 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a2cd253c-8540-48be-8da3-e7fe7807d65c tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:26 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-a2cd253c-8540-48be-8da3-e7fe7807d65c tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:52:26 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a2cd253c-8540-48be-8da3-e7fe7807d65c tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 200 len: 1234 microversion: 2.1 time: 0.151186 Apr 19 15:52:26 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 118/355] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:26 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 1234 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:52:28 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:28 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] Creating event network-changed:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:52:28 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-b667dd17-d121-43f2-91a9-8e93cf1762ec req-8ff2b245-4fe6-4eeb-ab13-40cdf4a11ce4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028130 Apr 19 15:52:28 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:30 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "name": "network-vif-plugged", "status": "completed", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:31 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] Creating event network-vif-plugged:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:52:31 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-dfd8f00c-0391-49b6-bcad-2de58dc28267 req-77dd72a0-7dbb-42fd-88eb-8d30d4733bc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Apr 19 15:52:31 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 121/357] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:33 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "name": "network-vif-plugged", "status": "completed", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:33 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:33 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:33 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:33 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] Creating event network-vif-plugged:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:52:33 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-d95896db-489e-439e-a4f7-2876da400935 req-224223fd-ecc6-411e-965a-01ff1b2bf7c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027884 Apr 19 15:52:33 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 119/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:33 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:52:33 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 HTTP/1.1 Apr 19 15:52:33 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:52:33 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:52:33 user devstack@n-api.service[72849]: Connection: close Apr 19 15:52:33 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:52:33 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:52:33 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:52:33 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:52:33 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:52:33 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:52:33 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:52:33 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:52:33 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:52:33 user devstack@n-api.service[72849]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:52:33 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:52:33 user devstack@n-api.service[72849]: method: > Apr 19 15:52:33 user devstack@n-api.service[72849]: exception: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:52:33 user devstack@n-api.service[72849]: action_args: {'id': '27332dd7-9cf0-4787-b615-72d4272f7fb1'} Apr 19 15:52:33 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:52:33 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:52:33 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:52:33 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-8b119367-02b4-4c73-8827-805eb81261b5 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 404 len: 111 microversion: 2.1 time: 0.026930 Apr 19 15:52:33 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:33 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:52:33 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-47e407a2-4704-4410-aef3-c815a718b75d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '.version_select at 0x7f11e0aa6e60>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:33 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-47e407a2-4704-4410-aef3-c815a718b75d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215325217" status: 202 len: 0 microversion: 2.1 time: 0.022651 Apr 19 15:52:33 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 122/360] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:52:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215325217 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:52:34 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-aa8480f3-d50c-448e-b9a1-5a04cdcb4c6e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Action: 'create', calling method: .version_select at 0x7f11e0931cf0>, body: {"keypair": {"name": "tempest-keypair-950507142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmM6Jck+sgqflHYQYyZAk120u6cnMT1OF685OpkhEpmGIKfWvLdlsVzM9H8RhkL7WmG0/r/b/pOz/G8ASLQmPxj9586tZZjxEtu/avpaIYpj4Sp9MrZWoc4gjTkf6KZcg=="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:34 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-aa8480f3-d50c-448e-b9a1-5a04cdcb4c6e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:52:34 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-aa8480f3-d50c-448e-b9a1-5a04cdcb4c6e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for user c38c4c3e9d6c4188a7fda942d147d9f4 and project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:52:34 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-aa8480f3-d50c-448e-b9a1-5a04cdcb4c6e tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044411 Apr 19 15:52:34 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 120/361] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:52:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:35 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1768752924", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "89435102-530e-4931-a234-9a7fb5e878c4"}], "security_groups": [{"name": "tempest-securitygroup--1147612547"}], "key_name": "tempest-keypair-950507142", "user_data": "}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:35 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:35 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] validate_networks() for [('89435102-530e-4931-a234-9a7fb5e878c4', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Getting quotas for user c38c4c3e9d6c4188a7fda942d147d9f4 and project c11a51b11d234c34a5ce2f2af04b03fe. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:52:36 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:52:36 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-9062967c-f203-4f98-b0e9-1f94864ec93a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.687225 Apr 19 15:52:36 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 120/362] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:52:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:52:36 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1311ce40-72a4-4f49-a42d-36d674d20e2d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:36 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-1311ce40-72a4-4f49-a42d-36d674d20e2d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:36 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-1311ce40-72a4-4f49-a42d-36d674d20e2d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:52:36 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-1311ce40-72a4-4f49-a42d-36d674d20e2d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 200 len: 1231 microversion: 2.1 time: 0.062865 Apr 19 15:52:36 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 123/363] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:36 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 1231 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:37 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:52:37 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-cf1c1ab9-c7b1-4df8-a623-4d3d87479302 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da" status: 204 len: 0 microversion: 2.1 time: 0.120464 Apr 19 15:52:37 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 121/364] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:52:37 2023] DELETE /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:37 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:38 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-unplugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:38 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:38 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:38 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:38 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:38 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] Creating event network-vif-unplugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:38 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-82503519-9e31-4ece-8306-05eabd6b5d38 req-2abf401e-957b-4bdb-881b-fdba8e066c7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039518 Apr 19 15:52:38 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 124/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:38 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df8741ec8d84d84a72fd76c9ebf729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2463ead51cd7410c860d488559676e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:52:38 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-4402b4b1-fcf5-4722-ac10-9c7fe0d174b6 tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da" status: 200 len: 1491 microversion: 2.1 time: 0.822960 Apr 19 15:52:38 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 121/366] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:37 2023] GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da => generated 1491 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:52:39 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:39 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:39 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] Creating event network-changed:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:52:39 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-46112624-605e-401b-8015-721a698f6f38 req-bd381f58-40bb-4b29-9502-a194d4c69e35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028865 Apr 19 15:52:39 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 122/367] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:39 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-deleted", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:39 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] Creating event network-vif-deleted:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:39 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-2bf947c9-58e8-4d57-a52f-93e17f77af39 req-cef7f249-e2b9-4620-b608-fd3a05315b47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 Apr 19 15:52:39 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 125/368] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:40 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}, {"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}, {"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}, {"server_uuid": "d434150b-9050-451d-999f-32a4103017da", "name": "network-vif-plugged", "status": "completed", "tag": "77c61073-6cbb-4a76-bb4b-c519612e472f"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:40 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] Creating event network-vif-plugged:77c61073-6cbb-4a76-bb4b-c519612e472f for instance d434150b-9050-451d-999f-32a4103017da on user Apr 19 15:52:40 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-4ae57850-d4b9-4423-944e-e7aad2db19eb req-2d15f3a7-6787-477a-be3b-343c9c005ac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032060 Apr 19 15:52:40 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 122/369] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:40 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:41 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "name": "network-vif-plugged", "status": "completed", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:41 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:52:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:41 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:41 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] Creating event network-vif-plugged:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:52:41 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-6527133c-024f-40be-8d38-b9e349e59a1f req-f1786d9a-0c81-4a79-a4c8-48f14dc5a681 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Apr 19 15:52:41 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] [instance: 761c0e45-abe5-4412-a433-c97f7d8212f1] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:41 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] HTTP exception thrown: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Request method failure captured: Apr 19 15:52:41 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 HTTP/1.1 Apr 19 15:52:41 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:52:41 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:52:41 user devstack@n-api.service[72850]: Connection: close Apr 19 15:52:41 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:52:41 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:52:41 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:52:41 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:52:41 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQAwPzsTq0a2Gf6cQJxPRTNhjpdeNPpmnFeKUTW-_Q6QQnk7YR5uLXzi7-mQFUknr9W64CFu3pp-7pid9_1iv02RQC1ab-ynOf7n00qeuvfdaD3sUz5NwJLHi7h1is66_RAV5ThtLfqiZ_LzPfvlzPwnnSmiVjW1RXu5Vg4WTOL9qVnQ Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Project-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Project-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d7a7d854e5047be8182fcc02f68c125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d7a7d854e5047be8182fcc02f68c125"}]}] Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Tenant: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Tenant-Id: 4d7a7d854e5047be8182fcc02f68c125 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-657294996 Apr 19 15:52:41 user devstack@n-api.service[72850]: X-User: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:52:41 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:52:41 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:52:41 user devstack@n-api.service[72850]: X-User-Id: f4f54b80641e48dfbc83ba21c1decb9c Apr 19 15:52:41 user devstack@n-api.service[72850]: X-User-Name: tempest-ServersNegativeTestJSON-657294996-project-member Apr 19 15:52:41 user devstack@n-api.service[72850]: method: > Apr 19 15:52:41 user devstack@n-api.service[72850]: exception: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. Apr 19 15:52:41 user devstack@n-api.service[72850]: action_args: {'id': '761c0e45-abe5-4412-a433-c97f7d8212f1'} Apr 19 15:52:41 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. Apr 19 15:52:41 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:52:41 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] Returning 404 to user: Instance 761c0e45-abe5-4412-a433-c97f7d8212f1 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:52:41 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-a9488f32-fe47-4271-bf40-ee4310f62534 tempest-ServersNegativeTestJSON-657294996 tempest-ServersNegativeTestJSON-657294996-project-member] 10.0.0.210 "GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1" status: 404 len: 111 microversion: 2.1 time: 0.031001 Apr 19 15:52:41 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 126/371] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:52:41 2023] GET /compute/v2.1/servers/761c0e45-abe5-4412-a433-c97f7d8212f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:52:43 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "name": "network-vif-plugged", "status": "completed", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:52:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:52:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:52:43 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:52:43 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] Creating event network-vif-plugged:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:52:43 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-5176e52b-db3e-4f89-ab49-f563e4aaf329 req-ef23f7aa-198e-41d8-9b6f-4c78342d9f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029664 Apr 19 15:52:43 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 123/372] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:07 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-0412a83a-6828-4ea4-aba0-0782171d7663 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 200 len: 1536 microversion: 2.1 time: 0.807328 Apr 19 15:53:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 124/373] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:06 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 1536 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Searching by: {'deleted': False, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136'} {{(pid=72850) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=8 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=10 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:07 user devstack@n-api.service[72850]: DEBUG nova.compute.multi_cell_list [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 15:53:07 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-ace9b503-3187-4b75-ba54-c967a93819a5 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.210089 Apr 19 15:53:07 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 127/374] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 15:53:07 2023] GET /compute/v2.1/servers => generated 340 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:53:07 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:07 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:07 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=16 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:08 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-337f7573-8d73-4fff-990b-e83260bb8ad8 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 200 len: 1536 microversion: 2.1 time: 0.150432 Apr 19 15:53:08 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:07 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 1536 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Going to try to terminate instance {{(pid=72851) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:53:09 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-2077aaec-08dc-4de1-9016-f2a487c5f268 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 204 len: 0 microversion: 2.1 time: 0.110502 Apr 19 15:53:09 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:53:09 2023] DELETE /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:09 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bdea4f36e5f49e5a279f7273f5a66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7533c8ab8a45baa3d4bf8373fc0136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-383a63cd-44f1-40c0-8f25-ab9ce74a6a0f tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 200 len: 1542 microversion: 2.1 time: 0.262908 Apr 19 15:53:09 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:09 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 1542 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:53:10 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "name": "network-vif-unplugged", "status": "completed", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:53:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:10 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] Creating event network-vif-unplugged:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:53:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-75d4aa14-5df6-441d-a2bb-e132270c1436 req-12c7f394-5d33-40f7-9085-ad680f9f08fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160306 Apr 19 15:53:10 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 125/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:53:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a6b02905-2540-4116-8aec-3e3de7dce6f9 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] Action: 'create', calling method: .version_select at 0x7f11e0931f30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-62094568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBofmMQSAH4Tq0bpXF+YIyby74JTuRUfI9805IrW90d4oix9xofjjRWpeF+T3TYqeYGe0CTjq9C9EijNwGEt+Ab/LaiM89pTZsT0lRokQJga2BmPga5EifWG1SrMxrRe1w=="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:53:10 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-a6b02905-2540-4116-8aec-3e3de7dce6f9 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] Getting quotas for project 20ffb0bbe836404bb24e094f4d020eb1. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:53:10 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-a6b02905-2540-4116-8aec-3e3de7dce6f9 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] Getting quotas for user 965264d0389e458a81f6a08f5297c91c and project 20ffb0bbe836404bb24e094f4d020eb1. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:53:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a6b02905-2540-4116-8aec-3e3de7dce6f9 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.051345 Apr 19 15:53:10 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 126/379] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:53:10 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:53:12 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "name": "network-vif-plugged", "status": "completed", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}, {"server_uuid": "14e694c9-db14-4985-848f-f5d5d4dba249", "name": "network-vif-deleted", "tag": "3c5e632f-614b-48d4-adb9-f1a1717744aa"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:53:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:12 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Creating event network-vif-plugged:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:53:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] Creating event network-vif-deleted:3c5e632f-614b-48d4-adb9-f1a1717744aa for instance 14e694c9-db14-4985-848f-f5d5d4dba249 on user Apr 19 15:53:12 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-ae2e752f-9aaa-4d86-ba7a-e4979cb852bd req-20c5ca58-ac93-4ce2-9a56-69850ada9d20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029248 Apr 19 15:53:12 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:53:13 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-0cf9e91d-ad09-4f9f-afaa-2b29c5539f95 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] Calling method '.version_select at 0x7f11e09a4040>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:13 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-0cf9e91d-ad09-4f9f-afaa-2b29c5539f95 tempest-TestVolumeBootPattern-1315715622 tempest-TestVolumeBootPattern-1315715622-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-62094568" status: 202 len: 0 microversion: 2.1 time: 0.023957 Apr 19 15:53:13 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 126/381] 10.0.0.210 () {62 vars in 1334 bytes} [Wed Apr 19 15:53:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-62094568 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:16 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:16 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-8cbed6be-03a7-4068-a68f-9a3209d89a9e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 200 len: 1544 microversion: 2.1 time: 0.277239 Apr 19 15:53:16 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:16 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 1544 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=16 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:26 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:53:26 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-61ffe759-4bba-4f48-b31d-ecaecc2fec90 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 200 len: 1538 microversion: 2.1 time: 0.224182 Apr 19 15:53:26 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 130/383] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:26 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 1538 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=8 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] [instance: d434150b-9050-451d-999f-32a4103017da] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:53:28 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] HTTP exception thrown: Instance d434150b-9050-451d-999f-32a4103017da could not be found. Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Request method failure captured: Apr 19 15:53:28 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da HTTP/1.1 Apr 19 15:53:28 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:53:28 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:53:28 user devstack@n-api.service[72849]: Connection: close Apr 19 15:53:28 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:53:28 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:53:28 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:53:28 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:53:28 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA3TAgCLAsRkY_GIDzWeaBzSzrvYuc6Ln9bLJbRuruSc_bTTRLN0wAIvOmEtKRgzei3K_FatGsVkhjDBtBoyFwb3TqMnfdUCOi1RvKv7slldxGxGTwO7kv6xYp6t7Q6Io0F4n56-vaK-yyoHnrna--0q2f6hoWrE9g8Uc-51gVLnqPc Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Project-Id: 2463ead51cd7410c860d488559676e4f Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Project-Name: tempest-VolumesActionsTest-1090227518 Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2463ead51cd7410c860d488559676e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2463ead51cd7410c860d488559676e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2463ead51cd7410c860d488559676e4f"}]}] Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Tenant: tempest-VolumesActionsTest-1090227518 Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Tenant-Id: 2463ead51cd7410c860d488559676e4f Apr 19 15:53:28 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-VolumesActionsTest-1090227518 Apr 19 15:53:28 user devstack@n-api.service[72849]: X-User: tempest-VolumesActionsTest-1090227518-project-member Apr 19 15:53:28 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:53:28 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:53:28 user devstack@n-api.service[72849]: X-User-Id: 6df8741ec8d84d84a72fd76c9ebf729f Apr 19 15:53:28 user devstack@n-api.service[72849]: X-User-Name: tempest-VolumesActionsTest-1090227518-project-member Apr 19 15:53:28 user devstack@n-api.service[72849]: method: > Apr 19 15:53:28 user devstack@n-api.service[72849]: exception: Instance d434150b-9050-451d-999f-32a4103017da could not be found. Apr 19 15:53:28 user devstack@n-api.service[72849]: action_args: {'id': 'd434150b-9050-451d-999f-32a4103017da'} Apr 19 15:53:28 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d434150b-9050-451d-999f-32a4103017da could not be found. Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d434150b-9050-451d-999f-32a4103017da could not be found. Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d434150b-9050-451d-999f-32a4103017da could not be found. Apr 19 15:53:28 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:53:28 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] Returning 404 to user: Instance d434150b-9050-451d-999f-32a4103017da could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:53:28 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-7c84ebc4-930e-4f84-85e9-ab95f732a04c tempest-VolumesActionsTest-1090227518 tempest-VolumesActionsTest-1090227518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da" status: 404 len: 111 microversion: 2.1 time: 0.038416 Apr 19 15:53:28 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 127/384] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:53:28 2023] GET /compute/v2.1/servers/d434150b-9050-451d-999f-32a4103017da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] [instance: 14e694c9-db14-4985-848f-f5d5d4dba249] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:00 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] HTTP exception thrown: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Request method failure captured: Apr 19 15:54:00 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 HTTP/1.1 Apr 19 15:54:00 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:54:00 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:54:00 user devstack@n-api.service[72851]: Connection: close Apr 19 15:54:00 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:54:00 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:54:00 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:54:00 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:54:00 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA1Eju9kFkEy5TpSia28nAua1TZ0yAGp0EasBxk2jeCQZQUXPrwmy4d5K0-llmRzZJTGtaMxNeT0_hcN8N6EFsaX7-dOh92crHE6ce_gIiqwRmfbYxIc83DfDMhoBLYyJ-SBl1Mm7JnJp-DFdOFhRTNi2x36sa7fUR_8P_qVUWsRpDQ Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Project-Id: 2f7533c8ab8a45baa3d4bf8373fc0136 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Project-Name: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f7533c8ab8a45baa3d4bf8373fc0136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f7533c8ab8a45baa3d4bf8373fc0136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f7533c8ab8a45baa3d4bf8373fc0136"}]}] Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Tenant: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Tenant-Id: 2f7533c8ab8a45baa3d4bf8373fc0136 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-TestMinimumBasicScenario-591841759 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-User: tempest-TestMinimumBasicScenario-591841759-project-member Apr 19 15:54:00 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:54:00 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:54:00 user devstack@n-api.service[72851]: X-User-Id: 6bdea4f36e5f49e5a279f7273f5a66e6 Apr 19 15:54:00 user devstack@n-api.service[72851]: X-User-Name: tempest-TestMinimumBasicScenario-591841759-project-member Apr 19 15:54:00 user devstack@n-api.service[72851]: method: > Apr 19 15:54:00 user devstack@n-api.service[72851]: exception: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. Apr 19 15:54:00 user devstack@n-api.service[72851]: action_args: {'id': '14e694c9-db14-4985-848f-f5d5d4dba249'} Apr 19 15:54:00 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. Apr 19 15:54:00 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:54:00 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Returning 404 to user: Instance 14e694c9-db14-4985-848f-f5d5d4dba249 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:54:00 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-958465d0-4610-4902-bc94-7e35798218a4 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249" status: 404 len: 111 microversion: 2.1 time: 0.240698 Apr 19 15:54:00 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:54:00 2023] GET /compute/v2.1/servers/14e694c9-db14-4985-848f-f5d5d4dba249 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:54:00 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-800c0475-bde5-4b18-9112-68491176d713 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] Calling method '.version_select at 0x7f11e0aa7010>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:00 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:00 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:00 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-800c0475-bde5-4b18-9112-68491176d713 tempest-TestMinimumBasicScenario-591841759 tempest-TestMinimumBasicScenario-591841759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1547822728" status: 202 len: 0 microversion: 2.1 time: 0.025034 Apr 19 15:54:00 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 131/386] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 15:54:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1547822728 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:16 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:17 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d3b52d12-dbc0-4b72-87f6-4858c53815d9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.167183 Apr 19 15:54:17 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 128/387] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:54:16 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:18 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:18 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-774a9503-861c-4c2d-8dfe-719ba97b6964 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb/ips" status: 200 len: 108 microversion: 2.1 time: 0.041292 Apr 19 15:54:18 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 132/388] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:54:18 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:18 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:18 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] Creating event network-changed:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:54:18 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-ba41e9b3-1920-45b8-aba0-b98ac77e81c2 req-22a7be80-7cce-4382-a643-457db00c39d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198384 Apr 19 15:54:18 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 129/389] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:19 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:54:19 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-e7c635a2-e147-441e-bdd9-26f84c4f4db4 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 204 len: 0 microversion: 2.1 time: 0.106706 Apr 19 15:54:19 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 129/390] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:54:19 2023] DELETE /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:19 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "name": "network-vif-unplugged", "status": "completed", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:19 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:54:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:19 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:19 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-5771a521-5e85-4446-a72d-250cd85453d7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 200 len: 1669 microversion: 2.1 time: 0.243838 Apr 19 15:54:19 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 133/391] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:54:19 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:54:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] Creating event network-vif-unplugged:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:54:19 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-8bf9b06a-f884-444a-bed4-ebbca034711e req-742c1a0b-dd66-4545-8811-079c8f3d4fdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028455 Apr 19 15:54:19 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:21 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "name": "network-vif-plugged", "status": "completed", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}, {"server_uuid": "2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb", "name": "network-vif-deleted", "tag": "f84945a9-1e03-4314-bb67-215e109ffc4e"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:21 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Creating event network-vif-plugged:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:54:21 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] Creating event network-vif-deleted:f84945a9-1e03-4314-bb67-215e109ffc4e for instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb on user Apr 19 15:54:21 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-09754f27-f0f0-410a-aeea-a6b819a33e65 req-a09dc51f-88d6-4e12-a057-ba7fa41ede78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031678 Apr 19 15:54:21 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 130/393] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:26 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:27 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-cada3737-88f8-483c-8a1f-4c1f3e782d24 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.468123 Apr 19 15:54:27 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 134/394] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:54:26 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc/os-interface => generated 283 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:27 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:27 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:27 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:27 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:27 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] Creating event network-changed:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:54:27 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-37e4d887-1273-4d3b-818d-151b681b8f68 req-9160913b-cf77-41fa-bce7-0fa6d0d5c36a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027093 Apr 19 15:54:27 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:27 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:27 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-679d7f43-d04f-4824-aba1-151ed66ba9b4 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc/ips" status: 200 len: 105 microversion: 2.1 time: 0.034021 Apr 19 15:54:27 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 131/396] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:54:27 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc/ips => generated 105 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:29 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:54:29 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-7cc0b99c-5069-47f6-b466-ca6723165477 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 204 len: 0 microversion: 2.1 time: 0.110644 Apr 19 15:54:29 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 135/397] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:54:29 2023] DELETE /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:29 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c4c3e9d6c4188a7fda942d147d9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c11a51b11d234c34a5ce2f2af04b03fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:54:29 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-362c3e96-88dd-4cad-8896-ccdb33af0ecd tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 200 len: 1662 microversion: 2.1 time: 0.285298 Apr 19 15:54:29 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 132/398] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:54:29 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 1662 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:54:29 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "name": "network-vif-unplugged", "status": "completed", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}, {"server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "name": "network-vif-plugged", "status": "completed", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:29 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:29 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Creating event network-vif-unplugged:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:54:29 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] Creating event network-vif-plugged:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:54:29 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-4f37ea97-acc7-400b-a014-32bd0b11215f req-db90e2a9-ba20-4802-b755-1677ee946bc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028208 Apr 19 15:54:29 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 132/399] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:29 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:54:31 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc674e-6575-4da2-98d7-88f0db3830bc", "name": "network-vif-deleted", "tag": "80467c85-0f18-4ae7-ba12-97a8027ebfd7"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:54:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:54:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:54:31 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:54:31 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] Creating event network-vif-deleted:80467c85-0f18-4ae7-ba12-97a8027ebfd7 for instance 11dc674e-6575-4da2-98d7-88f0db3830bc on user Apr 19 15:54:31 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-7f622fcf-df6e-4d4f-96b7-34c696456a56 req-7b55f09f-6a0d-4060-bfdd-6b89772a1e49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028551 Apr 19 15:54:31 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 136/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:54:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=8 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=12 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:09 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 15:55:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 15:55:10 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb HTTP/1.1 Apr 19 15:55:10 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:55:10 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:55:10 user devstack@n-api.service[72851]: Connection: close Apr 19 15:55:10 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:55:10 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:55:10 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:55:10 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:55:10 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 15:55:10 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:55:10 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:55:10 user devstack@n-api.service[72851]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 15:55:10 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 15:55:10 user devstack@n-api.service[72851]: method: > Apr 19 15:55:10 user devstack@n-api.service[72851]: exception: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 15:55:10 user devstack@n-api.service[72851]: action_args: {'id': '2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb'} Apr 19 15:55:10 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 15:55:10 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:10 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:10 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a3ceb0a5-90b6-4fa4-8d01-dc0e5a640854 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 404 len: 111 microversion: 2.1 time: 0.036237 Apr 19 15:55:10 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 133/401] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:55:09 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:55:10 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-5bb1ed52-1c43-4dbd-a594-4c2b7c739184 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '.version_select at 0x7f11e09a68c0>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:10 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:10 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:10 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-5bb1ed52-1c43-4dbd-a594-4c2b7c739184 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965047516" status: 202 len: 0 microversion: 2.1 time: 0.045228 Apr 19 15:55:10 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 133/402] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 15:55:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965047516 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:55:10 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:10 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:10 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-c4ddcb27-e711-42f9-986c-6c0dc3c604e7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: .version_select at 0x7f11e0aa7490>, body: {"keypair": {"name": "tempest-keypair-220553051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMWVkh80wqwjUkU+mvV6V8yypDj8VgP9eo3hVG76UgLjd/z0uwUmF5U95q8QcKi/k16kJQUhxE5DqAVVdPf1xlVyIjKLzJI1zQ2y4S3ab4kZghnxLI6hMOC/Jax5PEK1Q=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:55:10 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-c4ddcb27-e711-42f9-986c-6c0dc3c604e7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:55:10 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-c4ddcb27-e711-42f9-986c-6c0dc3c604e7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:55:10 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-c4ddcb27-e711-42f9-986c-6c0dc3c604e7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055022 Apr 19 15:55:10 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 137/403] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:55:10 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:55:12 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759932341", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7"}], "security_groups": [{"name": "tempest-securitygroup--1311418414"}], "key_name": "tempest-keypair-220553051", "user_data": "}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:55:12 user devstack@n-api.service[72851]: DEBUG nova.network.neutron [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] validate_networks() for [('d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7', None, None, None, None, None)] {{(pid=72851) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image limits 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image pref 0:0:0 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.virt.hardware [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72851) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Going to run 1 instances... {{(pid=72851) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:55:13 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72851) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:55:13 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-45fdd8eb-c350-4c3f-9763-bb4e2759f95a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.688995 Apr 19 15:55:13 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 134/404] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:55:12 2023] POST /compute/v2.1/servers => generated 400 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:55:13 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-972ce4e9-33fe-47e2-a8f5-2e809c73da6d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:13 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-972ce4e9-33fe-47e2-a8f5-2e809c73da6d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:13 user devstack@n-api.service[72849]: DEBUG nova.policy [None req-972ce4e9-33fe-47e2-a8f5-2e809c73da6d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72849) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:55:13 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-972ce4e9-33fe-47e2-a8f5-2e809c73da6d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 200 len: 1234 microversion: 2.1 time: 0.066911 Apr 19 15:55:13 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 134/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:55:13 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 1234 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:55:15 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:55:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:15 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:15 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] Creating event network-changed:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:55:15 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-052be947-13fd-4337-9f52-c8f57d41f8cc req-e88d9bfd-cc48-4654-b342-76efeac363ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029644 Apr 19 15:55:15 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 138/406] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:55:17 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:55:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:17 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:55:17 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-2e4eb327-0e66-494d-bb19-b79965c7b549 req-9de8deda-cf8e-423a-91cc-c0659827aafe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158156 Apr 19 15:55:17 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 135/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:19 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:55:19 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:55:19 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc HTTP/1.1 Apr 19 15:55:19 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:55:19 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:55:19 user devstack@n-api.service[72849]: Connection: close Apr 19 15:55:19 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:55:19 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:55:19 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:55:19 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:55:19 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:19 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:19 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:19 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:55:19 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:55:19 user devstack@n-api.service[72849]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:55:19 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:19 user devstack@n-api.service[72849]: method: > Apr 19 15:55:19 user devstack@n-api.service[72849]: exception: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:19 user devstack@n-api.service[72849]: action_args: {'id': '11dc674e-6575-4da2-98d7-88f0db3830bc'} Apr 19 15:55:19 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:19 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:19 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:19 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:19 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-213a2666-706c-490e-863d-2b5f175c6c8a tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 404 len: 111 microversion: 2.1 time: 0.173864 Apr 19 15:55:19 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 135/408] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:55:19 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:55:19 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-b9528c39-f439-4edf-af39-8efbfd066e46 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '.version_select at 0x7f11e0b11d80>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:19 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:55:19 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-f62ea011-d42b-4961-922c-6329975cc2cf req-df55ca92-9768-4041-9fdd-6663c77b8b87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043664 Apr 19 15:55:19 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 139/409] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:55:20 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-b9528c39-f439-4edf-af39-8efbfd066e46 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950507142" status: 202 len: 0 microversion: 2.1 time: 0.027098 Apr 19 15:55:20 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 136/410] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 15:55:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950507142 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:55:20 user devstack@n-api.service[72849]: request: DELETE /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc HTTP/1.1 Apr 19 15:55:20 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:55:20 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:55:20 user devstack@n-api.service[72849]: Connection: close Apr 19 15:55:20 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:55:20 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:55:20 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:55:20 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:55:20 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:20 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:20 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:55:20 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:55:20 user devstack@n-api.service[72849]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:55:20 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:20 user devstack@n-api.service[72849]: method: > Apr 19 15:55:20 user devstack@n-api.service[72849]: exception: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72849]: action_args: {'id': '11dc674e-6575-4da2-98d7-88f0db3830bc'} Apr 19 15:55:20 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:20 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-ce29c2a5-37a3-4267-8ecf-e460a1422e7d tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 404 len: 111 microversion: 2.1 time: 0.034707 Apr 19 15:55:20 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 136/411] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:55:20 2023] DELETE /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 11dc674e-6575-4da2-98d7-88f0db3830bc] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=4 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:55:20 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc HTTP/1.1 Apr 19 15:55:20 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:55:20 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:55:20 user devstack@n-api.service[72850]: Connection: close Apr 19 15:55:20 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:55:20 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:55:20 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:55:20 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:55:20 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:20 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:20 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:20 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:55:20 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:55:20 user devstack@n-api.service[72850]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:55:20 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:20 user devstack@n-api.service[72850]: method: > Apr 19 15:55:20 user devstack@n-api.service[72850]: exception: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72850]: action_args: {'id': '11dc674e-6575-4da2-98d7-88f0db3830bc'} Apr 19 15:55:20 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. Apr 19 15:55:20 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:55:20 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 11dc674e-6575-4da2-98d7-88f0db3830bc could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:20 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f7bf290c-a1cd-4661-8edb-51226fdd36c3 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc" status: 404 len: 111 microversion: 2.1 time: 0.032464 Apr 19 15:55:20 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 140/412] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:55:20 2023] GET /compute/v2.1/servers/11dc674e-6575-4da2-98d7-88f0db3830bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:21 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:55:21 user devstack@n-api.service[72851]: request: DELETE /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 HTTP/1.1 Apr 19 15:55:21 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:55:21 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:55:21 user devstack@n-api.service[72851]: Connection: close Apr 19 15:55:21 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:55:21 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:55:21 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:55:21 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:55:21 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:21 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:21 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:55:21 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:55:21 user devstack@n-api.service[72851]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:55:21 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:21 user devstack@n-api.service[72851]: method: > Apr 19 15:55:21 user devstack@n-api.service[72851]: exception: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72851]: action_args: {'id': '27332dd7-9cf0-4787-b615-72d4272f7fb1'} Apr 19 15:55:21 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:21 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-62a31a8e-2a43-4b98-bdc2-d28ad7574d73 tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 404 len: 111 microversion: 2.1 time: 0.032336 Apr 19 15:55:21 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 137/413] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:55:21 2023] DELETE /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] [instance: 27332dd7-9cf0-4787-b615-72d4272f7fb1] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:55:21 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] HTTP exception thrown: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Request method failure captured: Apr 19 15:55:21 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 HTTP/1.1 Apr 19 15:55:21 user devstack@n-api.service[72849]: Accept: application/json Apr 19 15:55:21 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 15:55:21 user devstack@n-api.service[72849]: Connection: close Apr 19 15:55:21 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 15:55:21 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 15:55:21 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 15:55:21 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 15:55:21 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA2b2nS-4yvuuunXc5RbdphDZAnISOLeuddblrL2xxqRSMP2BABzH4N0UfsBeVXZqhYfV5yn4IV0aaRL3Z-rYfvGQzUx_N9Lfr2j1rvkgy86S2D1TDRKqgCAVK6Rnm5qf6gYyz8HGRyzHv504JGxU22Airh-7GTxiEsb4Hwaxy0el5o Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Project-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c11a51b11d234c34a5ce2f2af04b03fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c11a51b11d234c34a5ce2f2af04b03fe"}]}] Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Tenant-Id: c11a51b11d234c34a5ce2f2af04b03fe Apr 19 15:55:21 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-685384009 Apr 19 15:55:21 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:21 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 15:55:21 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 15:55:21 user devstack@n-api.service[72849]: X-User-Id: c38c4c3e9d6c4188a7fda942d147d9f4 Apr 19 15:55:21 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeTestJSON-685384009-project-member Apr 19 15:55:21 user devstack@n-api.service[72849]: method: > Apr 19 15:55:21 user devstack@n-api.service[72849]: exception: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72849]: action_args: {'id': '27332dd7-9cf0-4787-b615-72d4272f7fb1'} Apr 19 15:55:21 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. Apr 19 15:55:21 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 15:55:21 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] Returning 404 to user: Instance 27332dd7-9cf0-4787-b615-72d4272f7fb1 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:55:21 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-585df31c-09b9-46b7-b606-3d7b5f27d4ff tempest-AttachVolumeTestJSON-685384009 tempest-AttachVolumeTestJSON-685384009-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1" status: 404 len: 111 microversion: 2.1 time: 0.031011 Apr 19 15:55:21 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:55:21 2023] GET /compute/v2.1/servers/27332dd7-9cf0-4787-b615-72d4272f7fb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 15:56:01 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:01 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:01 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-2ee104fe-3047-418c-a451-30846514bdbf tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Action: 'create', calling method: .version_select at 0x7f11e0aa6c20>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-798379832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEltTVHr5/GCtgVriEbWZRtH6U1/wU+NHwUI5PtKtr/mTfXBkCuqlJXmjR5dRuXm6B7TsciJez5+mkR1dwegrixUsfOXZOqE8n5O3JsV9voqtfw79VQKNuMnUUvrJslOdQ=="}} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:56:01 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-2ee104fe-3047-418c-a451-30846514bdbf tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Getting quotas for project 3df96250893c4e04bc8aaff0e0623b9c. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:56:01 user devstack@n-api.service[72850]: DEBUG nova.quota [None req-2ee104fe-3047-418c-a451-30846514bdbf tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Getting quotas for user 85563e13aef94c338dfc6b02951cdb0e and project 3df96250893c4e04bc8aaff0e0623b9c. Resources: {'key_pairs'} {{(pid=72850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:56:01 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-2ee104fe-3047-418c-a451-30846514bdbf tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.253488 Apr 19 15:56:01 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 141/415] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:56:01 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=8 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1818440922", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-798379832", "security_groups": [{"name": "tempest-secgroup-smoke-1733015550"}], "networks": [{"uuid": "5a004163-8697-44f3-b7a3-bef7e8653edc"}]}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:03 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] validate_networks() for [('5a004163-8697-44f3-b7a3-bef7e8653edc', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:56:03 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:56:03 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-bb0d3cc9-721a-4c1b-9e01-874d554cb861 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 200 len: 1545 microversion: 2.1 time: 0.326166 Apr 19 15:56:03 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 138/416] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:56:03 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 1545 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Getting quotas for project 3df96250893c4e04bc8aaff0e0623b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Getting quotas for user 85563e13aef94c338dfc6b02951cdb0e and project 3df96250893c4e04bc8aaff0e0623b9c. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:56:04 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:56:04 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-0f965a93-f283-499e-9337-d48204a2f1d1 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.830035 Apr 19 15:56:04 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 138/417] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:56:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:56:04 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-179d2439-5249-44a8-b41b-35f6f291072d tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:56:04 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-179d2439-5249-44a8-b41b-35f6f291072d tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:56:04 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-179d2439-5249-44a8-b41b-35f6f291072d tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85563e13aef94c338dfc6b02951cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df96250893c4e04bc8aaff0e0623b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:56:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-179d2439-5249-44a8-b41b-35f6f291072d tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 200 len: 1256 microversion: 2.1 time: 0.064171 Apr 19 15:56:04 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:56:04 2023] GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 1256 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:56:06 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:56:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:06 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:06 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] Creating event network-changed:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:56:06 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-df8c831d-1bba-4ce7-8233-6bdfc5a4ecca req-ddcb16f3-8695-4520-80ac-787d957cf798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036973 Apr 19 15:56:06 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 139/419] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:56:08 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "name": "network-vif-plugged", "status": "completed", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:56:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] Creating event network-vif-plugged:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:56:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-c0cf39eb-324c-4aea-90b2-f9a419de85ba req-65688b64-9f6f-4785-ab0f-7004445b75ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038592 Apr 19 15:56:08 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:56:10 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "name": "network-vif-plugged", "status": "completed", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:56:10 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:10 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:10 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:10 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] Creating event network-vif-plugged:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:56:10 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-72d46113-e7f3-4bb8-8453-329b542240ab req-88750c94-dab1-4e64-90f6-ce9b2bed5608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048156 Apr 19 15:56:10 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 143/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=8 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:56:54 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85563e13aef94c338dfc6b02951cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df96250893c4e04bc8aaff0e0623b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:56:54 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-bc854bae-1b72-48da-8c6a-87cdd1f7147b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 200 len: 1568 microversion: 2.1 time: 0.299019 Apr 19 15:56:54 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 140/422] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:56:54 2023] GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:03 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:04 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-afdd00e2-cc5b-4c8e-9ebe-820bf0fd5bbe tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.173345 Apr 19 15:57:04 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:57:03 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585/os-interface => generated 283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell0:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:04 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] Creating event network-changed:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:04 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-e8c96f40-47a7-491b-8aee-9c3e6eabe709 req-041cb848-49d1-4854-bc99-04a9be2d21ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044863 Apr 19 15:57:04 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:04 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:05 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-20be0c12-0419-4732-91a3-6a122132d8b3 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585/ips" status: 200 len: 109 microversion: 2.1 time: 0.060854 Apr 19 15:57:05 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 141/425] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:57:04 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585/ips => generated 109 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:06 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:57:06 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-d8a4b5db-d90b-4dd8-89ce-92e54382b2d5 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 204 len: 0 microversion: 2.1 time: 0.114537 Apr 19 15:57:06 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:57:06 2023] DELETE /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:06 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:57:06 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-1450dfdb-6631-4290-9daf-5bfff798cf2f tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 200 len: 1670 microversion: 2.1 time: 0.269312 Apr 19 15:57:06 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:57:06 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:57:07 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-unplugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] Creating event network-vif-unplugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-5d7211f0-478c-468f-9eb3-7936aed1ce7a req-6d399f87-0a8d-4ddc-aa66-69410d4d86a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038156 Apr 19 15:57:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 142/428] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:08 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-deleted", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:08 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] Creating event network-vif-deleted:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:08 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-9aee0fa8-8bba-4a24-9586-ce9882778452 req-41fa79fb-c58d-4015-ad3d-84d496ef5e41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031861 Apr 19 15:57:08 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:09 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}, {"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}, {"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}, {"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-unplugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}, {"server_uuid": "e9b767b9-3bb5-4391-87a9-9ea6c1ca2585", "name": "network-vif-plugged", "status": "completed", "tag": "41d3dd5e-4519-418d-9135-4f8a79fb139b"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:09 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Creating event network-vif-unplugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] Creating event network-vif-plugged:41d3dd5e-4519-418d-9135-4f8a79fb139b for instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 on user Apr 19 15:57:09 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-434c9c74-d43b-46d4-bca2-1e1fd2464709 req-0105affb-2e4d-4a62-b36a-941cde14b412 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034878 Apr 19 15:57:09 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:54 user devstack@n-api.service[72851]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:57:54 user devstack@n-api.service[72851]: Wed Apr 19 15:57:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 (ip 10.0.0.210) !!! Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:54 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:55 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85563e13aef94c338dfc6b02951cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df96250893c4e04bc8aaff0e0623b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:57:55 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-ec706575-adcb-4b64-9896-02ada16343a5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 200 len: 1568 microversion: 2.1 time: 0.375246 Apr 19 15:57:55 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 143/431] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:57:54 2023] GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:56 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Going to try to terminate instance {{(pid=72849) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:57:56 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-6dc074bd-1000-48b1-9f48-17569400a43b tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 204 len: 0 microversion: 2.1 time: 0.132092 Apr 19 15:57:56 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 143/432] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:57:56 2023] DELETE /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=10 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:56 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "name": "network-vif-unplugged", "status": "completed", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:57 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] Creating event network-vif-unplugged:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:57:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-41bd6e45-ec30-44e6-bda1-a191a7f8aed9 req-584a23a1-e954-4f1b-9847-87a4534b1749 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028548 Apr 19 15:57:57 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 144/433] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 15:57:57 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 HTTP/1.1 Apr 19 15:57:57 user devstack@n-api.service[72851]: Accept: application/json Apr 19 15:57:57 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 15:57:57 user devstack@n-api.service[72851]: Connection: close Apr 19 15:57:57 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 15:57:57 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 15:57:57 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 15:57:57 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 15:57:57 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 15:57:57 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 15:57:57 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 15:57:57 user devstack@n-api.service[72851]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 15:57:57 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 15:57:57 user devstack@n-api.service[72851]: method: > Apr 19 15:57:57 user devstack@n-api.service[72851]: exception: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 15:57:57 user devstack@n-api.service[72851]: action_args: {'id': 'e9b767b9-3bb5-4391-87a9-9ea6c1ca2585'} Apr 19 15:57:57 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 15:57:57 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:57:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-16d41760-54b2-468a-b99a-de16e408d5b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 404 len: 111 microversion: 2.1 time: 0.262825 Apr 19 15:57:57 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 144/434] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:57:56 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 15:57:57 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-f74776a4-366d-485f-b9be-ab6c2eb5472a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '.version_select at 0x7f11e09a77f0>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:57:57 user devstack@n-api.service[72850]: DEBUG nova.policy [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85563e13aef94c338dfc6b02951cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df96250893c4e04bc8aaff0e0623b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72850) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:57:57 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-a0b689f9-3f18-4b90-8a91-8797151d81ed tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 200 len: 1574 microversion: 2.1 time: 0.344311 Apr 19 15:57:57 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:57:56 2023] GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 1574 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:57:57 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-f74776a4-366d-485f-b9be-ab6c2eb5472a tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220553051" status: 202 len: 0 microversion: 2.1 time: 0.023352 Apr 19 15:57:57 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 19 15:57:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220553051 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-53dc0d23-bd01-43e1-a6c2-0383052413b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: .version_select at 0x7f11e0933c70>, body: {"keypair": {"name": "tempest-keypair-1562223892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6K5pKUGovPZ/sXV5EUFSz/wz6dnKBKmeWngMfQ3TrBUosZ84gVLHtb9wCId08yn/0c/sgE0cx8mY0MIZAfQTt1MldqUQILF7ylzj0UKvfaueYYjifn1i6nrRuJDNvlRg=="}} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-53dc0d23-bd01-43e1-a6c2-0383052413b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:57:57 user devstack@n-api.service[72851]: DEBUG nova.quota [None req-53dc0d23-bd01-43e1-a6c2-0383052413b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'key_pairs'} {{(pid=72851) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:57:57 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-53dc0d23-bd01-43e1-a6c2-0383052413b8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050494 Apr 19 15:57:57 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 145/437] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 15:57:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:59 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "name": "network-vif-plugged", "status": "completed", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}, {"server_uuid": "3dc98a20-40af-410d-9a12-424a72b06b77", "name": "network-vif-deleted", "tag": "7658041f-923b-4715-980b-2ed5503f5073"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:59 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:57:59 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:57:59 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:57:59 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Creating event network-vif-plugged:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:57:59 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] Creating event network-vif-deleted:7658041f-923b-4715-980b-2ed5503f5073 for instance 3dc98a20-40af-410d-9a12-424a72b06b77 on user Apr 19 15:57:59 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-f723261a-d2d2-48b0-a164-7d2b134e1456 req-86b0e78f-630e-4609-93a5-a3cfce5ea210 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028660 Apr 19 15:57:59 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 148/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:57:59 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1764902583", "imageRef": "054b9710-7933-4467-9e07-bc414d3de236", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7"}], "security_groups": [{"name": "tempest-securitygroup--1045383967"}], "key_name": "tempest-keypair-1562223892", "user_data": "}} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:57:59 user devstack@n-api.service[72849]: DEBUG nova.network.neutron [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] validate_networks() for [('d55c5c8c-cdbd-4cd7-9249-de21cf8cb9d7', None, None, None, None, None)] {{(pid=72849) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image limits 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Flavor pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Image pref 0:0:0 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.virt.hardware [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.quota [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Getting quotas for user c76480d6d0c84d15b06f5cac0dd511f4 and project 0c0984f297a847a2b58da65a2db97400. Resources: {'cores', 'instances', 'ram'} {{(pid=72849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Going to run 1 instances... {{(pid=72849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 15:58:00 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='054b9710-7933-4467-9e07-bc414d3de236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 15:58:00 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-74a64dc7-38bb-4677-8195-fafdc526ee4e tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.773154 Apr 19 15:58:00 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 146/439] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 15:57:59 2023] POST /compute/v2.1/servers => generated 400 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 15:58:00 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-a7962aac-7c51-4bb9-acb9-24c94094b8fd tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:58:00 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-a7962aac-7c51-4bb9-acb9-24c94094b8fd tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:58:00 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-a7962aac-7c51-4bb9-acb9-24c94094b8fd tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:58:00 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-a7962aac-7c51-4bb9-acb9-24c94094b8fd tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 200 len: 1236 microversion: 2.1 time: 0.077011 Apr 19 15:58:00 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 146/440] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:58:00 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 1236 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:58:02 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:58:02 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:02 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:02 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:02 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] Creating event network-changed:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:58:02 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-5da1b4dd-5ba8-4c7b-9d51-e4d10642b051 req-a03be531-5a06-4f42-a116-385225a93ff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027372 Apr 19 15:58:02 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:58:05 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "name": "network-vif-plugged", "status": "completed", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:58:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:05 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] Creating event network-vif-plugged:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:58:05 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-fe65ec2c-ec07-4b18-81b6-aeef65587e1e req-9d039125-266f-45c3-af6d-44a4bb97bee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046495 Apr 19 15:58:05 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:58:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:58:07 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "name": "network-vif-plugged", "status": "completed", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:58:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:07 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.compute.server_external_events [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] Creating event network-vif-plugged:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:58:07 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [req-d85d1dcc-ac01-4015-9c3f-b0cdd7e9d74a req-0d959c74-8cff-42dc-8161-a81e040bdf1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033127 Apr 19 15:58:07 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 147/443] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:58:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:58:47 user devstack@n-api.service[72850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:58:47 user devstack@n-api.service[72850]: Wed Apr 19 15:58:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 (ip 10.0.0.210) !!! Apr 19 15:58:47 user devstack@n-api.service[72850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 15:58:47 user devstack@n-api.service[72850]: Wed Apr 19 15:58:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 (ip 10.0.0.210) !!! Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=6 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=10 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] [instance: 3dc98a20-40af-410d-9a12-424a72b06b77] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:47 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] HTTP exception thrown: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Request method failure captured: Apr 19 15:58:47 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 HTTP/1.1 Apr 19 15:58:47 user devstack@n-api.service[72850]: Accept: application/json Apr 19 15:58:47 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 15:58:47 user devstack@n-api.service[72850]: Connection: close Apr 19 15:58:47 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 15:58:47 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 15:58:47 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 15:58:47 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 15:58:47 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQA8Lhv7OvG30lYT6FePOu2MJZaJPOGMOesiVzSTL0D6EEuwuZsEPnfNnwZ6VqE5ef892Bzc3xptFcW6zI7jYpX1zWdPXHZ34wx-6rQLws1264aNzZpfr6U3wuWxYTLEI2oTurMs0vPuqegZMur6_mWNGosiUKbCANGkGG_ck_m0b3QE Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Project-Id: 3df96250893c4e04bc8aaff0e0623b9c Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Project-Name: tempest-SnapshotDataIntegrityTests-30609823 Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3df96250893c4e04bc8aaff0e0623b9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3df96250893c4e04bc8aaff0e0623b9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3df96250893c4e04bc8aaff0e0623b9c"}]}] Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Tenant: tempest-SnapshotDataIntegrityTests-30609823 Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Tenant-Id: 3df96250893c4e04bc8aaff0e0623b9c Apr 19 15:58:47 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-30609823 Apr 19 15:58:47 user devstack@n-api.service[72850]: X-User: tempest-SnapshotDataIntegrityTests-30609823-project-member Apr 19 15:58:47 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 15:58:47 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 15:58:47 user devstack@n-api.service[72850]: X-User-Id: 85563e13aef94c338dfc6b02951cdb0e Apr 19 15:58:47 user devstack@n-api.service[72850]: X-User-Name: tempest-SnapshotDataIntegrityTests-30609823-project-member Apr 19 15:58:47 user devstack@n-api.service[72850]: method: > Apr 19 15:58:47 user devstack@n-api.service[72850]: exception: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. Apr 19 15:58:47 user devstack@n-api.service[72850]: action_args: {'id': '3dc98a20-40af-410d-9a12-424a72b06b77'} Apr 19 15:58:47 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. Apr 19 15:58:47 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 15:58:47 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Returning 404 to user: Instance 3dc98a20-40af-410d-9a12-424a72b06b77 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 15:58:47 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-ce9a2a4d-ba10-413b-bfcf-1e3f97d3a5b5 tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77" status: 404 len: 111 microversion: 2.1 time: 0.043376 Apr 19 15:58:47 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 150/444] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:58:47 2023] GET /compute/v2.1/servers/3dc98a20-40af-410d-9a12-424a72b06b77 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 15:58:47 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=2 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell0:SELECT=6 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:47 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-ffa84443-1713-4fc2-b5eb-17079b2c037c tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] Calling method '.version_select at 0x7f11e09a6830>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:58:47 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-ffa84443-1713-4fc2-b5eb-17079b2c037c tempest-SnapshotDataIntegrityTests-30609823 tempest-SnapshotDataIntegrityTests-30609823-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-798379832" status: 202 len: 0 microversion: 2.1 time: 0.048135 Apr 19 15:58:47 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:58:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-798379832 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell0:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=10 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:58:50 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:58:50 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-eac60bbf-e486-4fed-b8e0-1ea3c2ad99f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 200 len: 1547 microversion: 2.1 time: 0.263616 Apr 19 15:58:50 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 148/446] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:58:50 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 1547 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=2 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:50 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:50 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-522707c0-9904-45bb-a219-7d2a474281ba tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159613 Apr 19 15:59:50 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 151/447] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 15:59:50 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112/os-interface => generated 283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=2 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=6 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:51 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:51 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-2a7aab12-7522-4977-b168-a93dcde61cc7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112/ips" status: 200 len: 109 microversion: 2.1 time: 0.043131 Apr 19 15:59:51 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 15:59:51 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:59:52 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:59:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:52 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:52 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] Creating event network-changed:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:59:52 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-2dc6b26b-3355-4004-a7a7-c2f7fa38e27e req-7f854c8b-833b-4b92-85ea-4078e1468134 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271129 Apr 19 15:59:52 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 149/449] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:53 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Going to try to terminate instance {{(pid=72850) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 15:59:53 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-bb376573-2b42-447b-8d0b-377bafb769e8 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 204 len: 0 microversion: 2.1 time: 0.121475 Apr 19 15:59:53 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 15:59:53 2023] DELETE /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:53 user devstack@n-api.service[72851]: DEBUG nova.policy [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76480d6d0c84d15b06f5cac0dd511f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0984f297a847a2b58da65a2db97400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72851) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 15:59:53 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-ab62e3b5-5735-42e2-8bc6-4d4d1b2a12e9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 200 len: 1672 microversion: 2.1 time: 0.236393 Apr 19 15:59:53 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 15:59:53 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 15:59:54 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "name": "network-vif-unplugged", "status": "completed", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}, {"server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "name": "network-vif-plugged", "status": "completed", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:59:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:54 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:54 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Creating event network-vif-unplugged:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:59:54 user devstack@n-api.service[72849]: INFO nova.api.openstack.compute.server_external_events [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] Creating event network-vif-plugged:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:59:54 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [req-89598eee-b848-426a-9c43-15772956cf0e req-d24395fc-b21e-4690-8650-d745ee6ee268 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032092 Apr 19 15:59:54 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 150/452] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 15:59:54 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebb2680-0b3f-4094-b7b6-20f016241112", "name": "network-vif-deleted", "tag": "2ab34f1b-b608-442f-bbb8-4319a08cb941"}]} {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 15:59:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 15:59:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 15:59:54 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 15:59:55 user devstack@n-api.service[72850]: INFO nova.api.openstack.compute.server_external_events [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] Creating event network-vif-deleted:2ab34f1b-b608-442f-bbb8-4319a08cb941 for instance 3ebb2680-0b3f-4094-b7b6-20f016241112 on user Apr 19 15:59:55 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [req-5a52d7f6-4565-4806-be62-9108ed66f80b req-3e1292aa-a5b6-470d-9cda-3f40502c3144 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120153 Apr 19 15:59:55 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 153/453] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 15:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_api:SELECT=4 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG dbcounter [-] [72851] Writing DB stats nova_cell1:SELECT=10 {{(pid=72851) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:43 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:43 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 HTTP/1.1 Apr 19 16:00:43 user devstack@n-api.service[72851]: Accept: application/json Apr 19 16:00:43 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 16:00:43 user devstack@n-api.service[72851]: Connection: close Apr 19 16:00:43 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 16:00:43 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 16:00:43 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 16:00:43 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 16:00:43 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:43 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 16:00:43 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 16:00:43 user devstack@n-api.service[72851]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:43 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:43 user devstack@n-api.service[72851]: method: > Apr 19 16:00:43 user devstack@n-api.service[72851]: exception: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:43 user devstack@n-api.service[72851]: action_args: {'id': '3ebb2680-0b3f-4094-b7b6-20f016241112'} Apr 19 16:00:43 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:43 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:43 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:43 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-316b851a-05ca-47e3-aa1d-1d6938f4e2ec tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 404 len: 111 microversion: 2.1 time: 0.034111 Apr 19 16:00:43 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:00:43 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:43 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:43 user devstack@n-api.service[72849]: DEBUG dbcounter [-] [72849] Writing DB stats nova_cell1:SELECT=4 {{(pid=72849) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:43 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-c1df7d2e-b8ec-48c3-b9a2-c41a5f58bc6b tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '.version_select at 0x7f11e09a4ca0>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:43 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-c1df7d2e-b8ec-48c3-b9a2-c41a5f58bc6b tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562223892" status: 202 len: 0 microversion: 2.1 time: 0.025266 Apr 19 16:00:43 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 151/455] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 16:00:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562223892 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG dbcounter [-] [72850] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72850) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:44 user devstack@n-api.service[72850]: request: DELETE /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 HTTP/1.1 Apr 19 16:00:44 user devstack@n-api.service[72850]: Accept: application/json Apr 19 16:00:44 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 16:00:44 user devstack@n-api.service[72850]: Connection: close Apr 19 16:00:44 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 16:00:44 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 16:00:44 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 16:00:44 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 16:00:44 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:44 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 16:00:44 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 16:00:44 user devstack@n-api.service[72850]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:44 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:44 user devstack@n-api.service[72850]: method: > Apr 19 16:00:44 user devstack@n-api.service[72850]: exception: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72850]: action_args: {'id': '3ebb2680-0b3f-4094-b7b6-20f016241112'} Apr 19 16:00:44 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:44 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-e6f32916-bfb1-4a0c-b796-f286bb4cf0f7 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 404 len: 111 microversion: 2.1 time: 0.041148 Apr 19 16:00:44 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:00:44 2023] DELETE /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 3ebb2680-0b3f-4094-b7b6-20f016241112] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:44 user devstack@n-api.service[72851]: request: GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 HTTP/1.1 Apr 19 16:00:44 user devstack@n-api.service[72851]: Accept: application/json Apr 19 16:00:44 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 16:00:44 user devstack@n-api.service[72851]: Connection: close Apr 19 16:00:44 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 16:00:44 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 16:00:44 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 16:00:44 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 16:00:44 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:44 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 16:00:44 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 16:00:44 user devstack@n-api.service[72851]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:44 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:44 user devstack@n-api.service[72851]: method: > Apr 19 16:00:44 user devstack@n-api.service[72851]: exception: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72851]: action_args: {'id': '3ebb2680-0b3f-4094-b7b6-20f016241112'} Apr 19 16:00:44 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. Apr 19 16:00:44 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:44 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 3ebb2680-0b3f-4094-b7b6-20f016241112 could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:44 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-ebdb81e0-388b-4b02-ad27-626fc37ada0d tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112" status: 404 len: 111 microversion: 2.1 time: 0.032192 Apr 19 16:00:44 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:00:44 2023] GET /compute/v2.1/servers/3ebb2680-0b3f-4094-b7b6-20f016241112 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:45 user devstack@n-api.service[72849]: request: DELETE /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 HTTP/1.1 Apr 19 16:00:45 user devstack@n-api.service[72849]: Accept: application/json Apr 19 16:00:45 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 16:00:45 user devstack@n-api.service[72849]: Connection: close Apr 19 16:00:45 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 16:00:45 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 16:00:45 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 16:00:45 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 16:00:45 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72849]: method: > Apr 19 16:00:45 user devstack@n-api.service[72849]: exception: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: action_args: {'id': 'e9b767b9-3bb5-4391-87a9-9ea6c1ca2585'} Apr 19 16:00:45 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-78500701-9365-421e-a7b8-d9d3322e55f9 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 404 len: 111 microversion: 2.1 time: 0.047101 Apr 19 16:00:45 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:00:45 2023] DELETE /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG nova.compute.api [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: e9b767b9-3bb5-4391-87a9-9ea6c1ca2585] Fetching instance by UUID {{(pid=72850) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG oslo_concurrency.lockutils [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72850) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.wsgi [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:45 user devstack@n-api.service[72850]: request: GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 HTTP/1.1 Apr 19 16:00:45 user devstack@n-api.service[72850]: Accept: application/json Apr 19 16:00:45 user devstack@n-api.service[72850]: Accept-Encoding: identity Apr 19 16:00:45 user devstack@n-api.service[72850]: Connection: close Apr 19 16:00:45 user devstack@n-api.service[72850]: Content-Length: 0 Apr 19 16:00:45 user devstack@n-api.service[72850]: Content-Type: application/json Apr 19 16:00:45 user devstack@n-api.service[72850]: Host: 10.0.0.210 Apr 19 16:00:45 user devstack@n-api.service[72850]: Openstack-System-Scope: None Apr 19 16:00:45 user devstack@n-api.service[72850]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Domain-Id: None Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Domain-Name: None Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Identity-Status: Confirmed Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Is-Admin-Project: True Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Project-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Project-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Role: member,reader Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Roles: member,reader Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72850]: X-User-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72850]: X-User-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72850]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:45 user devstack@n-api.service[72850]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72850]: method: > Apr 19 16:00:45 user devstack@n-api.service[72850]: exception: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72850]: action_args: {'id': 'e9b767b9-3bb5-4391-87a9-9ea6c1ca2585'} Apr 19 16:00:45 user devstack@n-api.service[72850]: {{(pid=72850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. Apr 19 16:00:45 user devstack@n-api.service[72850]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72850]: DEBUG nova.api.openstack.wsgi [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 could not be found. {{(pid=72850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:45 user devstack@n-api.service[72850]: INFO nova.api.openstack.requestlog [None req-f691c374-d7fc-44ad-aae3-d63d58eb1a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585" status: 404 len: 111 microversion: 2.1 time: 0.026898 Apr 19 16:00:45 user devstack@n-api.service[72850]: [pid: 72850|app: 0|req: 155/459] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:00:45 2023] GET /compute/v2.1/servers/e9b767b9-3bb5-4391-87a9-9ea6c1ca2585 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG nova.compute.api [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72851) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG oslo_concurrency.lockutils [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72851) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.wsgi [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:45 user devstack@n-api.service[72851]: request: DELETE /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb HTTP/1.1 Apr 19 16:00:45 user devstack@n-api.service[72851]: Accept: application/json Apr 19 16:00:45 user devstack@n-api.service[72851]: Accept-Encoding: identity Apr 19 16:00:45 user devstack@n-api.service[72851]: Connection: close Apr 19 16:00:45 user devstack@n-api.service[72851]: Content-Length: 0 Apr 19 16:00:45 user devstack@n-api.service[72851]: Content-Type: application/json Apr 19 16:00:45 user devstack@n-api.service[72851]: Host: 10.0.0.210 Apr 19 16:00:45 user devstack@n-api.service[72851]: Openstack-System-Scope: None Apr 19 16:00:45 user devstack@n-api.service[72851]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Domain-Id: None Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Domain-Name: None Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Identity-Status: Confirmed Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Is-Admin-Project: True Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Project-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Project-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Role: member,reader Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Roles: member,reader Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72851]: X-User-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72851]: X-User-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72851]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:45 user devstack@n-api.service[72851]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72851]: method: > Apr 19 16:00:45 user devstack@n-api.service[72851]: exception: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72851]: action_args: {'id': '2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb'} Apr 19 16:00:45 user devstack@n-api.service[72851]: {{(pid=72851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72851]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72851]: DEBUG nova.api.openstack.wsgi [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. {{(pid=72851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:45 user devstack@n-api.service[72851]: INFO nova.api.openstack.requestlog [None req-49ea5d65-9755-4ad4-943f-9f31fc657969 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 404 len: 111 microversion: 2.1 time: 0.032554 Apr 19 16:00:45 user devstack@n-api.service[72851]: [pid: 72851|app: 0|req: 153/460] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 16:00:45 2023] DELETE /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Calling method '>' {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.compute.api [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] [instance: 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb] Fetching instance by UUID {{(pid=72849) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Acquiring lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG oslo_concurrency.lockutils [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Lock "1d1abc72-4a1e-46ad-b3ce-2880abea9047" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72849) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 16:00:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.wsgi [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] HTTP exception thrown: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Request method failure captured: Apr 19 16:00:45 user devstack@n-api.service[72849]: request: GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb HTTP/1.1 Apr 19 16:00:45 user devstack@n-api.service[72849]: Accept: application/json Apr 19 16:00:45 user devstack@n-api.service[72849]: Accept-Encoding: identity Apr 19 16:00:45 user devstack@n-api.service[72849]: Connection: close Apr 19 16:00:45 user devstack@n-api.service[72849]: Content-Length: 0 Apr 19 16:00:45 user devstack@n-api.service[72849]: Content-Type: application/json Apr 19 16:00:45 user devstack@n-api.service[72849]: Host: 10.0.0.210 Apr 19 16:00:45 user devstack@n-api.service[72849]: Openstack-System-Scope: None Apr 19 16:00:45 user devstack@n-api.service[72849]: User-Agent: python-urllib3/1.26.15 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Auth-Token: gAAAAABkQA43C6QbswcfyHslQfxRB3JSWF6lcrsAsSMPXl_JAhMEHPNmOSxqRr-WNGGjVT-CG6WhFZjQtlt9_pmRqxvW8FlaMJOAsMgD_FaeCieWhLLkjBRDqnf3afFvlolWjp8892_cATrcJ3exRL0lz_0idq0h_y1exTqgrpaEXAMWvXgVtSk Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Domain-Id: None Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Domain-Name: None Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Identity-Status: Confirmed Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Is-Admin-Project: True Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Role: member,reader Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Roles: member,reader Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c0984f297a847a2b58da65a2db97400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c0984f297a847a2b58da65a2db97400"}]}] Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant-Id: 0c0984f297a847a2b58da65a2db97400 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311273076 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Domain-Id: default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Domain-Name: Default Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Id: c76480d6d0c84d15b06f5cac0dd511f4 Apr 19 16:00:45 user devstack@n-api.service[72849]: X-User-Name: tempest-AttachVolumeNegativeTest-1311273076-project-member Apr 19 16:00:45 user devstack@n-api.service[72849]: method: > Apr 19 16:00:45 user devstack@n-api.service[72849]: exception: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: action_args: {'id': '2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb'} Apr 19 16:00:45 user devstack@n-api.service[72849]: {{(pid=72849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. Apr 19 16:00:45 user devstack@n-api.service[72849]: ERROR nova.api.openstack.wsgi Apr 19 16:00:45 user devstack@n-api.service[72849]: DEBUG nova.api.openstack.wsgi [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] Returning 404 to user: Instance 2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb could not be found. {{(pid=72849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 16:00:45 user devstack@n-api.service[72849]: INFO nova.api.openstack.requestlog [None req-1a9b06c3-bab0-4ea5-99c5-6376c8168a07 tempest-AttachVolumeNegativeTest-1311273076 tempest-AttachVolumeNegativeTest-1311273076-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb" status: 404 len: 111 microversion: 2.1 time: 0.026903 Apr 19 16:00:45 user devstack@n-api.service[72849]: [pid: 72849|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 16:00:45 2023] GET /compute/v2.1/servers/2fee6c2a-a6c3-4c63-9c58-8a35482ec0eb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)